-- Logs begin at Mon 2022-07-04 09:28:21 UTC, end at Mon 2022-07-04 10:29:16 UTC. -- Jul 04 10:00:01.216717 dv-cinder-848418-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 04 10:00:01.226117 dv-cinder-848418-1-iscsi devstack@n-api.service[103346]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 04 10:00:01.228099 dv-cinder-848418-1-iscsi devstack@n-api.service[103346]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 4 10:00:01 2022] *** Jul 04 10:00:01.228099 dv-cinder-848418-1-iscsi devstack@n-api.service[103346]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 04 10:00:01.228099 dv-cinder-848418-1-iscsi devstack@n-api.service[103346]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 04 10:00:01.228099 dv-cinder-848418-1-iscsi devstack@n-api.service[103346]: nodename: dv-cinder-848418-1-iscsi Jul 04 10:00:01.228099 dv-cinder-848418-1-iscsi devstack@n-api.service[103346]: machine: x86_64 Jul 04 10:00:01.228099 dv-cinder-848418-1-iscsi devstack@n-api.service[103346]: clock source: unix Jul 04 10:00:01.228099 dv-cinder-848418-1-iscsi devstack@n-api.service[103346]: pcre jit disabled Jul 04 10:00:01.228099 dv-cinder-848418-1-iscsi devstack@n-api.service[103346]: detected number of CPU cores: 4 Jul 04 10:00:01.228099 dv-cinder-848418-1-iscsi devstack@n-api.service[103346]: current working directory: / Jul 04 10:00:01.228099 dv-cinder-848418-1-iscsi devstack@n-api.service[103346]: detected binary path: /usr/bin/uwsgi-core Jul 04 10:00:01.228712 dv-cinder-848418-1-iscsi devstack@n-api.service[103346]: your processes number limit is 47680 Jul 04 10:00:01.228712 dv-cinder-848418-1-iscsi devstack@n-api.service[103346]: your memory page size is 4096 bytes Jul 04 10:00:01.228712 dv-cinder-848418-1-iscsi devstack@n-api.service[103346]: detected max file descriptor number: 2048 Jul 04 10:00:01.228712 dv-cinder-848418-1-iscsi devstack@n-api.service[103346]: lock engine: pthread robust mutexes Jul 04 10:00:01.228712 dv-cinder-848418-1-iscsi devstack@n-api.service[103346]: thunder lock: enabled Jul 04 10:00:01.228712 dv-cinder-848418-1-iscsi devstack@n-api.service[103346]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 04 10:00:01.228712 dv-cinder-848418-1-iscsi devstack@n-api.service[103346]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 04 10:00:01.271295 dv-cinder-848418-1-iscsi devstack@n-api.service[103346]: Python main interpreter initialized at 0x563850e0e9c0 Jul 04 10:00:01.271295 dv-cinder-848418-1-iscsi devstack@n-api.service[103346]: python threads support enabled Jul 04 10:00:01.271295 dv-cinder-848418-1-iscsi devstack@n-api.service[103346]: your server socket listen backlog is limited to 100 connections Jul 04 10:00:01.271295 dv-cinder-848418-1-iscsi devstack@n-api.service[103346]: your mercy for graceful operations on workers is 90 seconds Jul 04 10:00:01.271665 dv-cinder-848418-1-iscsi devstack@n-api.service[103346]: mapped 403077 bytes (393 KB) for 2 cores Jul 04 10:00:01.271665 dv-cinder-848418-1-iscsi devstack@n-api.service[103346]: *** Operational MODE: preforking *** Jul 04 10:00:01.271967 dv-cinder-848418-1-iscsi devstack@n-api.service[103346]: *** uWSGI is running in multiple interpreter mode *** Jul 04 10:00:01.271967 dv-cinder-848418-1-iscsi devstack@n-api.service[103346]: spawned uWSGI master process (pid: 103346) Jul 04 10:00:01.272178 dv-cinder-848418-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 04 10:00:01.276018 dv-cinder-848418-1-iscsi devstack@n-api.service[103346]: spawned uWSGI worker 1 (pid: 103347, cores: 1) Jul 04 10:00:01.276018 dv-cinder-848418-1-iscsi devstack@n-api.service[103346]: spawned uWSGI worker 2 (pid: 103348, cores: 1) Jul 04 10:00:01.276018 dv-cinder-848418-1-iscsi devstack@n-api.service[103346]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 04 10:00:01.921369 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 04 10:00:01.922062 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 04 10:00:03.027946 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 10:00:03.027946 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: from cryptography.utils import int_from_bytes Jul 04 10:00:03.028641 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 10:00:03.028641 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: from cryptography.utils import int_from_bytes Jul 04 10:00:03.028770 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 10:00:03.028770 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: from cryptography.utils import int_from_bytes Jul 04 10:00:03.029415 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 10:00:03.029415 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: from cryptography.utils import int_from_bytes Jul 04 10:00:05.447608 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 04 10:00:05.448164 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 04 10:00:05.448262 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 04 10:00:05.448262 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 04 10:00:05.448685 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 04 10:00:05.448767 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 04 10:00:05.448851 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 04 10:00:05.448851 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 04 10:00:05.448987 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 04 10:00:05.449157 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 04 10:00:05.449244 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.449511 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.449666 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.449866 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.450028 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.450134 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.450220 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.450479 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.450580 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.450895 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.451316 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.451316 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.451528 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.451618 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.451685 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.451901 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.452044 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.452134 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.452215 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.452416 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.452547 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.452712 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.452816 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848418-1-iscsi {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.453020 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848418-1-iscsi {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.453116 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.453354 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.453505 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.453683 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.453792 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.453988 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.454080 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.454289 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.454387 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.454595 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.454684 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.454906 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.455041 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.455204 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.455398 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.455818 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.455923 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.456001 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.456136 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.456284 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.456409 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.456742 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.456876 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.457046 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.457133 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.457223 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.457334 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.457525 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.457667 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.457870 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.457971 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.458182 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.458273 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.458502 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.458598 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.458813 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.458966 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848418-1-iscsi {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.459208 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848418-1-iscsi {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.459314 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.459524 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.459622 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.459831 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.459920 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.460140 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.460239 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.460553 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.460645 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.460839 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.460937 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.461148 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.461255 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.461468 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.461569 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.461800 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.461898 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.462119 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.462205 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.462433 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.462519 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.462747 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.462844 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.463052 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.463142 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.463356 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.463494 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.463661 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.463756 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.463961 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.464056 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.464268 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.464388 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.464568 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.464689 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.464865 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.464996 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.465112 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.465245 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.465407 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.465514 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.465733 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.465823 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.466050 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.466146 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.466393 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.466504 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.466717 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.466902 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.467073 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.467209 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.467332 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.467449 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.467590 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.467724 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.467866 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.467990 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.468110 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.468295 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.468417 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.468602 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.468723 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.468908 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.469030 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.469212 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.469357 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.469519 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.469672 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.469847 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.469976 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.470152 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.470254 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.470466 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.470553 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.470778 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.470867 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.471443 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.471534 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.471751 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.471889 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.472065 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.472197 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.472460 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.472570 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.472709 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.472821 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.473030 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.473138 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.473344 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.473483 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.473678 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.473778 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.473984 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.474078 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.474294 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.474394 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.474609 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.474706 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.474914 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.475003 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.475215 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.475386 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.475515 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.475601 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.475826 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.475913 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.476153 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.476249 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.476449 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.476535 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.476695 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.476781 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.476989 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.477085 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.477290 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.477396 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.477597 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.477703 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.477917 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.478013 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.478216 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.478313 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.478517 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.478606 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.478809 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.478898 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.479113 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.479198 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.479412 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.479498 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.479712 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.479799 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.480007 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.480094 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.480306 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.480403 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.480604 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.480689 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.480900 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.480985 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.481274 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.481384 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.481494 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.481582 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.481832 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.482131 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.482342 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.482738 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.482830 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.482923 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.483007 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.483087 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.483167 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.483373 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.483473 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.483685 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.483781 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.483987 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.484075 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.484292 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.484381 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.484593 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.484680 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.484897 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.484982 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.485199 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.485288 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.485500 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.485586 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.485827 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.485915 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.486133 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.486220 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.486440 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.486528 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.486736 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.486829 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.487038 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.487127 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.487350 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.487517 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.487661 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.487805 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.487942 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.488076 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.488208 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.488340 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.488501 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.488641 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.488785 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.488920 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.489087 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.489221 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.489366 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.489507 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.489686 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.489834 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.489983 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.490129 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.490267 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.490413 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.490568 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.490714 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.490870 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.491002 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.491172 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.491306 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.491472 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.491601 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.491774 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.491906 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.492087 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:00:05.492217 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.492416 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.492547 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.492745 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.492886 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.493058 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.493199 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.493385 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.493516 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.493758 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.493902 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.494039 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.494172 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.494331 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.494470 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.494643 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.494790 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.494963 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.495098 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.495273 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.495407 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.495583 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.495730 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.495890 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.496029 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.496200 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.496332 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.496514 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.496665 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.496821 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.496959 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.497141 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.497283 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.497455 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.497640 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.497849 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.498020 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.498162 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.498350 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.498482 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.498669 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.498794 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.498992 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.499113 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.499326 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.499411 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.499649 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.499745 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.499963 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.500077 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.500306 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.500402 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.500654 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.500740 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.500967 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.501053 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.501292 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.501392 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.501599 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.501792 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.501936 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.502024 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.502252 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.502347 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.502566 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.502655 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.502885 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.502979 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.503203 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.503304 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.503516 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.503605 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.503829 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.503926 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.504135 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.504231 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.504444 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.504530 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.504750 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.504835 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.505061 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.505148 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.505372 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.505466 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.505706 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.505807 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.506022 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.506118 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.506338 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.506424 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.506645 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.506732 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.506954 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.507042 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.507261 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.507347 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.507563 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.507664 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.507867 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.507962 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.508169 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.508254 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.508472 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.508567 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.508772 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.508857 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.509082 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.509244 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.509388 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.509483 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.509724 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.509824 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.510051 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.510144 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.510352 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.510445 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.510660 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.510748 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.510968 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.511053 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.511273 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.511360 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.511576 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.511670 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.511883 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.511969 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.512187 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.512273 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.512489 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.512622 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.512795 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.512881 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.513122 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.513276 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.513446 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.513530 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.513826 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.514039 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.514189 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.514325 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.514457 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.514589 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.514735 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.514883 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.515016 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.515149 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.515280 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.515421 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.515553 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.515694 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.515830 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.515981 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.516152 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.516239 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.516462 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.516559 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.516769 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.516856 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.517082 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.517168 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.517400 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.517513 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.517721 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.517821 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.518043 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.518130 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.518364 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.518450 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.518673 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.518758 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.518975 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.519069 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.519280 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.519367 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.519579 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.519666 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.519876 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.519971 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.520177 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.520269 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.520478 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.520565 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.520773 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.520859 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.521072 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.521160 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.521369 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.521462 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.521684 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.521786 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.521984 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.522071 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.522284 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.522369 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.522585 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.522719 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.522887 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.522974 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.523187 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.523282 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.523484 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.523583 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.523785 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.523871 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.524139 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.524251 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.524418 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.524591 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.524722 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.524817 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.525044 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.525130 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.525361 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.525450 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.525692 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.525782 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.526006 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.526094 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.526315 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.526410 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.526625 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.526711 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.526933 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.527019 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.527239 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.527325 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.527548 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.527634 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.527854 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.527938 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.528167 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.528254 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.528471 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.528566 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.528833 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.528929 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.529142 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.529229 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.529460 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.529671 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.529782 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.529883 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.530094 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.530182 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.530394 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.530479 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.530710 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.530810 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.531035 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.531120 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.531403 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.531500 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.531656 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.531752 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.531965 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.532060 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.532270 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.532364 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.532573 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.532674 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.532880 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.532968 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.533182 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.533267 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.533488 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.533591 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.533817 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.533918 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.534128 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.534239 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.534436 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.534534 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.534748 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.534844 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.535051 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.535147 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.535363 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.535451 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.535660 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.535747 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.535966 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.536055 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.536272 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.536365 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.536584 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.536679 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.536889 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.536976 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.537195 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.537284 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.537516 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.537643 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.537845 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.538002 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.538149 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.538245 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.538454 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.538547 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.538751 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.538854 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.539055 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.539142 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.539355 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.539445 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.539661 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.539757 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.539968 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.540053 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.540273 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.540411 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.540572 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.540695 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.541090 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.541223 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.541223 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.541372 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.541460 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.541541 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.541768 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.541857 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.542077 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.542174 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.542378 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.542464 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.542688 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.542773 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.543008 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.543102 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.543318 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.543406 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.543615 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.543700 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.543914 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.544008 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.544230 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.544338 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.544603 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.544764 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.544913 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.545059 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.545147 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.545227 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.545431 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.545519 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.545770 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.545880 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.546076 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.546174 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.546382 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.546469 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.546694 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.546789 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.546998 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.547093 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.547304 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.547391 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.547610 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.547711 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.547927 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.548057 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.548223 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.548323 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.548533 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.548621 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.548837 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.548924 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.549143 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.549238 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.549448 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.549536 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.549776 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.549864 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.550084 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.550182 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.550388 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.550476 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.550693 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.550788 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.550995 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.551081 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.551301 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.551389 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.551608 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.551692 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.551903 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.551997 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.552208 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.552303 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.552507 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.552600 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.552816 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.553086 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.553175 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.553417 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.553705 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.553795 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.554042 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.554146 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.554361 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.554447 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.554679 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.554801 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.554992 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.555096 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.555309 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.555409 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.555640 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.555737 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.555941 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.556038 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.556247 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.556336 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.556547 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.556648 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.556848 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.556936 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.557154 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.557251 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.557454 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.557542 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.557778 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.557877 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.558083 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.558250 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.558387 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.558522 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.558655 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.558794 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.558938 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.559071 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.559238 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.559380 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.559537 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.559672 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.559819 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.559990 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.560193 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.560370 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.560505 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.560635 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.560982 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.561117 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.561251 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.561383 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.561516 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.561681 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.561821 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.561957 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.562097 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.562249 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.562380 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.562522 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.562654 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.562785 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.562920 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.563052 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.563207 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.563306 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.563508 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.563595 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.563841 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.563928 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.564167 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.564271 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.564501 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.564587 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.564805 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.564898 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.565108 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.565205 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.565406 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.565503 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.565727 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.565818 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.566030 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.566117 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.566329 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.566423 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.566627 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.566713 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.566933 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.567019 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.567236 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.567329 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.567543 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.567628 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.567850 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.567994 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.568149 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.568282 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.568454 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.568540 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.568752 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.568844 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.569056 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.569148 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.569356 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.569452 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.569693 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.569794 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.569974 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.570061 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.570274 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.570375 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.570575 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.570661 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.570872 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.570965 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.571175 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.571270 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.571469 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.571555 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.571773 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.571866 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.572073 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.572173 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.572370 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.572456 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.572673 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.572759 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.572969 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.573055 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.573268 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.573353 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.573567 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.573698 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.573900 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.573996 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.574201 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.574287 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.574500 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.574630 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.574799 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.574895 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.575104 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.575197 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.575400 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.575486 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.575750 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.575931 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.576002 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.576068 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.576322 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.576504 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.576655 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.576761 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.576935 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.577088 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.577242 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.577402 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.577544 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.577740 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.577872 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.578054 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.578172 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.578361 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.578477 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.578667 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.578775 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.578969 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.579063 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.579276 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.579363 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.579576 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.579670 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.579878 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.579973 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.580178 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.580264 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.580480 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.580573 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.580779 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.580880 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.581087 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.581172 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.581387 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.581474 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.581710 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.581813 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.582013 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.582109 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.582316 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.582402 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.582656 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.582755 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.582958 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.583053 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.583268 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.583400 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.583577 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.583673 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.583884 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.583970 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.584193 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.584280 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.584494 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.584582 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.584804 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.584892 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.585110 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.585202 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.585410 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.585497 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.585736 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.585823 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.586040 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.586127 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.586348 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.586434 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.586651 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.586738 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.586952 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.587039 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.587265 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.587365 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.587574 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.587659 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.587885 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.587981 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.588183 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.588277 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.588492 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.588597 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.588796 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.588892 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.589102 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.589189 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.589405 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.589492 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.589737 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.589842 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.590044 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.590129 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.590353 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.590440 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.590660 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.590759 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.590967 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.591052 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.591317 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.591459 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.591619 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.591758 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.591966 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.592068 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.592227 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.592366 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.592526 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.592674 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.592848 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.592983 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.593156 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.593293 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.593459 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.593598 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.593792 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.593942 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.594095 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.594253 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.594404 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.594555 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.594704 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.594863 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.595122 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.595218 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.595427 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.595514 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.595731 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.595818 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.596372 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.596497 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.596678 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.596809 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.596985 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.597123 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.597296 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.597424 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.597604 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.597748 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.597943 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.598055 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.598354 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.598455 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.598669 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.598776 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.598969 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.599056 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.599273 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.599381 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.599572 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.599694 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.599870 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.600009 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.600176 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.600319 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.600494 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.600623 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.600794 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.600925 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.601096 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.601234 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.601394 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.601553 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.601737 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.601883 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.602038 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.602188 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.602354 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.602489 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.602767 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.602864 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.603072 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.603159 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.603372 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.603459 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.603778 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.603882 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.604083 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.604172 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.604382 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.604467 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.604700 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.604793 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.605018 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.605109 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.605334 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.605421 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.605650 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.605742 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.605963 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.606050 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.606268 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.606366 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.606585 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.606681 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.606926 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.607069 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.607236 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.607387 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.607538 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.607679 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.607830 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.607919 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.608148 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.608235 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.608460 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.608544 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.608763 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.608859 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.609074 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.609169 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.609392 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.609477 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.609727 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.609816 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.610046 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.610132 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.610404 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.610502 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.610726 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.610823 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.611026 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.611113 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.611326 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.611423 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.611632 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.611719 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.611936 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.612021 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.612236 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.612331 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.612542 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.612628 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.612846 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.612931 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.613146 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.613241 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.613450 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.613535 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.613776 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.613866 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.614077 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.614174 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.614375 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.614463 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.614680 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.614765 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.614976 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.615064 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.615275 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.615361 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.615585 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.615678 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.615884 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.615972 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.616203 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.616290 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.616502 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.616588 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.616818 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.616904 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.617119 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.617206 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.617419 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.617519 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.617741 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.617832 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.618041 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.618127 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.618348 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.618446 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.618654 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.618744 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.618956 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.619054 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.619278 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.619373 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.619586 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.619673 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.619898 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.619984 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.620223 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.620319 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.620541 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.620628 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.620849 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.620934 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.621161 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.621247 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.621481 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.621567 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.621803 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.621891 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.622104 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.622206 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.622409 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.622562 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.622806 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.623272 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.623391 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.623483 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.623586 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.623680 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.623789 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.623884 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.623980 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.624072 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.624223 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.624328 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.624519 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.624618 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.624833 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.624919 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.625130 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.625215 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.625428 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.625523 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.625765 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.625867 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.626064 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.626161 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.626364 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.626461 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.626660 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.626747 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.626968 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.627062 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.627271 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.627372 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.627572 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.627659 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.627894 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.627979 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.628200 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.628296 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.628521 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.628645 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.628827 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.628916 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.629145 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.629241 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.629456 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.629553 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.629790 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.629891 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.630101 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.630199 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.630410 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.630504 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.630720 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.630806 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.631030 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.631118 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.631341 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.631428 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.631646 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.631743 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.631957 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.632043 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.632263 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.632351 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.632575 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.632670 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.632888 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.633083 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.633203 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.633411 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.633520 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.633747 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.634057 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.634145 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.634365 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.634453 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.634676 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.634776 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.634984 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.635071 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.635294 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.635388 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.635599 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.635687 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.635906 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.636000 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.636211 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.636306 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.636522 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.636617 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.636838 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.636925 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.637149 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.637236 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.637478 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.637603 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.637814 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.637904 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.638150 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.638257 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.638456 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.638536 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.638801 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.638902 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.639088 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.639188 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.639407 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.639492 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.639710 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.639797 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.640022 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.640110 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.640331 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.640418 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.640642 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.640731 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.640949 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.641038 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.641256 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.641343 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.641563 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.641708 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.641895 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.641984 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.642202 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.642304 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.642508 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.642603 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.642818 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.642912 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.643125 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.643217 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.643435 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.643539 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.643748 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.643837 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.644066 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.644152 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.644376 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.644575 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.644687 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.644775 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.644999 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.645086 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.645314 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.645513 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.645641 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.645853 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.645964 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.646185 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.646482 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.646572 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.646801 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.646889 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.647119 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.647206 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.647432 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.647520 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.647752 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.647840 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.648055 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.648149 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.648358 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.648445 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.648668 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.648755 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.648976 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.649075 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.649276 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.649366 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.649584 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.649689 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.649916 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.650015 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.650219 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.650315 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.650536 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.650624 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.650844 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.650939 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.651148 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.651373 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.651468 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.651716 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.651812 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.652029 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.652278 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.652366 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.652621 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.652708 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.652937 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.653025 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.653254 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.653340 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.653574 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.653678 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.653945 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.654036 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.654248 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.654324 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.654571 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.654665 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.654876 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.654963 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.655181 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.655268 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.655497 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.655604 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.655806 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.655902 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.656109 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.656195 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.656408 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.656507 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.656715 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.656803 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.657015 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.657101 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.657315 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.657413 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.657653 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.657743 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.657946 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.658033 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.658248 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.658345 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.658554 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.658641 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.658857 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.658984 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.659161 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.659256 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.659464 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.659558 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.659765 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.659852 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.660068 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.660156 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.660365 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.660452 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.660665 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.660761 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.660965 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.661052 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.661264 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.661350 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.661563 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.661682 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.661891 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.661978 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.662203 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.662289 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.662505 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.662601 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.662816 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.662903 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.663115 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.663202 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.663427 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.663526 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.663733 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.663821 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.664045 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.664131 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.664348 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.664444 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.664655 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.664741 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.664971 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.665057 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.665288 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.665389 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.665598 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.665840 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.665964 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.666171 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.666266 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.666488 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.666804 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.666893 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.667126 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.667219 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.667429 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.667517 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.667730 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.667818 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.668029 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.668116 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.668348 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.668436 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.668654 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.668740 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.668959 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.669085 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.669262 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.669381 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.669611 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.669794 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.669948 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.670261 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.670355 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.670573 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.670662 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.670882 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.670969 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.671194 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.671286 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.671502 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.671588 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.671811 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.671897 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.672119 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.672207 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.672425 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.672511 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.672734 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.672829 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.673043 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.673129 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.673347 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.673432 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.673681 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.673906 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.674016 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.674103 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.674330 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.674416 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.674642 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.674737 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.674948 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.675043 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.675253 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.675341 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.675558 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.675691 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.675860 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.675955 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.676165 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.676251 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.676471 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.676559 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.676786 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.676871 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.677089 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.677177 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.677408 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.677495 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.677739 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.677830 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.678129 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.678228 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.678449 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.678536 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.678757 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.678844 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.679072 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.679204 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.679382 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.679476 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.679689 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.679782 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.680005 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.680100 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.680311 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.680398 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.680630 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.680723 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.680940 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.681028 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.681266 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.681396 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.681581 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.681732 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.681907 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.682004 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.682207 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.682296 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.682507 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.682595 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.682818 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.682915 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.683119 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.683206 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.683427 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.683515 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.683724 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.683811 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.684020 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.684115 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.684320 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.684413 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.684616 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.684712 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.684918 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.685077 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.685374 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.685477 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.685764 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.685860 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.685992 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.686092 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.686295 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.686392 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.686607 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.686697 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.686912 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.686999 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.687214 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.687309 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.687513 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.687600 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.687813 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.687899 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.688113 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.688202 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.688410 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.688496 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.688710 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.688797 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.689009 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.689105 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.689307 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.689394 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.689605 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.689747 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.689936 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.690023 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.690237 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.690325 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.690559 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.690644 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.690875 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.690964 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.691181 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.691268 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.691495 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.691592 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.691799 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.691886 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.692112 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.692200 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.692420 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.692522 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.692726 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.692821 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.693036 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.693124 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.693346 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.693440 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.693675 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.693766 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.693989 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.694075 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.694300 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.694405 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.694606 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.694692 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.694909 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.695036 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.695216 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.695312 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.695525 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.695612 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.695841 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.695973 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.696142 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.696244 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.696461 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.696560 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.696772 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.696868 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.697085 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.697181 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.697399 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.697496 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.697776 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.697886 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.698045 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.698140 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.698355 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.698459 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.698671 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.698778 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.698976 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.699072 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.699281 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.699391 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.699590 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.699708 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.699895 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.699998 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.700205 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.700302 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.700519 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.700609 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.700867 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.701343 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.701343 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.701513 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.701603 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.701718 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.701800 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.701926 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.702127 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.702255 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.702425 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.702581 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.702770 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.702928 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.703093 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.703242 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.703406 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.703582 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.703714 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.703906 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.704015 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.704222 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.704318 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 04 10:00:05.704535 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.704837 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:00:05.705081 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 04 10:00:05.765679 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO dbcounter [None req-1a4f3b31-339e-4457-a441-e50af408f4b8 None None] Registered counter for database nova_api Jul 04 10:00:05.767070 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO dbcounter [None req-7dc92c10-f8ef-4ec7-a2a1-9a0abdeda2ff None None] Registered counter for database nova_api Jul 04 10:00:05.883060 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG oslo_db.sqlalchemy.engines [None req-7dc92c10-f8ef-4ec7-a2a1-9a0abdeda2ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103348) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 10:00:05.884823 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG oslo_db.sqlalchemy.engines [None req-1a4f3b31-339e-4457-a441-e50af408f4b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103347) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 10:00:05.890520 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writer thread running {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 10:00:05.891781 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG dbcounter [-] [103347] Writer thread running {{(pid=103347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 10:00:05.945754 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.context [None req-7dc92c10-f8ef-4ec7-a2a1-9a0abdeda2ff None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fcfe76a9-294c-4e42-99a5-517031194304(cell1) {{(pid=103348) load_cells /opt/stack/nova/nova/context.py:464}} Jul 04 10:00:05.946778 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.context [None req-1a4f3b31-339e-4457-a441-e50af408f4b8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fcfe76a9-294c-4e42-99a5-517031194304(cell1) {{(pid=103347) load_cells /opt/stack/nova/nova/context.py:464}} Jul 04 10:00:05.949809 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-7dc92c10-f8ef-4ec7-a2a1-9a0abdeda2ff None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:00:05.950956 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG oslo_concurrency.lockutils [None req-1a4f3b31-339e-4457-a441-e50af408f4b8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:00:05.951486 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-7dc92c10-f8ef-4ec7-a2a1-9a0abdeda2ff None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:00:05.952281 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-7dc92c10-f8ef-4ec7-a2a1-9a0abdeda2ff None None] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:00:05.952534 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG oslo_concurrency.lockutils [None req-1a4f3b31-339e-4457-a441-e50af408f4b8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:00:05.953307 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG oslo_concurrency.lockutils [None req-1a4f3b31-339e-4457-a441-e50af408f4b8 None None] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:00:05.954380 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-7dc92c10-f8ef-4ec7-a2a1-9a0abdeda2ff None None] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:00:05.955417 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG oslo_concurrency.lockutils [None req-1a4f3b31-339e-4457-a441-e50af408f4b8 None None] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:00:05.956379 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO dbcounter [None req-7dc92c10-f8ef-4ec7-a2a1-9a0abdeda2ff None None] Registered counter for database nova_cell0 Jul 04 10:00:05.957412 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO dbcounter [None req-1a4f3b31-339e-4457-a441-e50af408f4b8 None None] Registered counter for database nova_cell0 Jul 04 10:00:05.960237 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO dbcounter [None req-7dc92c10-f8ef-4ec7-a2a1-9a0abdeda2ff None None] Registered counter for database nova_cell1 Jul 04 10:00:05.961223 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO dbcounter [None req-1a4f3b31-339e-4457-a441-e50af408f4b8 None None] Registered counter for database nova_cell1 Jul 04 10:00:05.968659 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG oslo_db.sqlalchemy.engines [None req-7dc92c10-f8ef-4ec7-a2a1-9a0abdeda2ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103348) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 10:00:05.974076 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG oslo_db.sqlalchemy.engines [None req-1a4f3b31-339e-4457-a441-e50af408f4b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103347) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 10:00:05.974450 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writer thread running {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 10:00:05.975112 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG oslo_db.sqlalchemy.engines [None req-7dc92c10-f8ef-4ec7-a2a1-9a0abdeda2ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103348) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 10:00:05.978573 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG oslo_db.sqlalchemy.engines [None req-1a4f3b31-339e-4457-a441-e50af408f4b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103347) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 10:00:05.981549 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG dbcounter [-] [103347] Writer thread running {{(pid=103347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 10:00:06.118134 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writer thread running {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 10:00:06.128898 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO dbcounter [None req-7dc92c10-f8ef-4ec7-a2a1-9a0abdeda2ff None None] Registered counter for database nova_cell0 Jul 04 10:00:06.129855 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG dbcounter [-] [103347] Writer thread running {{(pid=103347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 10:00:06.141543 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG oslo_db.sqlalchemy.engines [None req-7dc92c10-f8ef-4ec7-a2a1-9a0abdeda2ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103348) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 10:00:06.143161 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO dbcounter [None req-1a4f3b31-339e-4457-a441-e50af408f4b8 None None] Registered counter for database nova_cell0 Jul 04 10:00:06.147098 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writer thread running {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 10:00:06.152116 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG oslo_db.sqlalchemy.engines [None req-1a4f3b31-339e-4457-a441-e50af408f4b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103347) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 10:00:06.156998 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG dbcounter [-] [103347] Writer thread running {{(pid=103347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 10:00:06.481084 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: WARNING keystonemiddleware.auth_token [None req-7dc92c10-f8ef-4ec7-a2a1-9a0abdeda2ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 10:00:06.483675 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: WARNING keystonemiddleware.auth_token [None req-1a4f3b31-339e-4457-a441-e50af408f4b8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 10:00:06.488543 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: WARNING keystonemiddleware.auth_token [None req-7dc92c10-f8ef-4ec7-a2a1-9a0abdeda2ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 10:00:06.490873 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: WARNING keystonemiddleware.auth_token [None req-1a4f3b31-339e-4457-a441-e50af408f4b8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 10:00:06.828471 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: WARNING keystonemiddleware.auth_token [None req-7dc92c10-f8ef-4ec7-a2a1-9a0abdeda2ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 10:00:06.831126 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: WARNING keystonemiddleware.auth_token [None req-1a4f3b31-339e-4457-a441-e50af408f4b8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 10:00:06.834488 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: WARNING keystonemiddleware.auth_token [None req-7dc92c10-f8ef-4ec7-a2a1-9a0abdeda2ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 10:00:06.837030 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: WARNING keystonemiddleware.auth_token [None req-1a4f3b31-339e-4457-a441-e50af408f4b8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 10:00:06.839759 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563850e0e9c0 pid: 103348 (default app) Jul 04 10:00:06.841901 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-7dc92c10-f8ef-4ec7-a2a1-9a0abdeda2ff None None] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:00:06.842497 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563850e0e9c0 pid: 103347 (default app) Jul 04 10:00:06.843094 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-7dc92c10-f8ef-4ec7-a2a1-9a0abdeda2ff None None] 10.222.0.79 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001809 Jul 04 10:00:06.843486 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 1/1] 10.222.0.79 () {50 vars in 788 bytes} [Mon Jul 4 10:00:06 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:01:22.990716 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-1a4f3b31-339e-4457-a441-e50af408f4b8 None None] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:01:22.992087 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-1a4f3b31-339e-4457-a441-e50af408f4b8 None None] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002165 Jul 04 10:01:22.992665 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 1/2] 10.222.0.79 () {54 vars in 930 bytes} [Mon Jul 4 10:01:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:01:23.004609 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_api:SELECT=3 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:01:23.005770 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_cell1:SELECT=3 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:01:23.006761 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_cell0:SELECT=3 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:01:23.007481 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:01:23.460928 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-1cea1e36-f9c9-4a5c-89da-6cfe360a6ac4 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:01:23.492382 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-1cea1e36-f9c9-4a5c-89da-6cfe360a6ac4 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.492810 Jul 04 10:01:23.493159 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 2/3] 10.222.0.79 () {60 vars in 1291 bytes} [Mon Jul 4 10:01:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:01:25.584618 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-1a4f3b31-339e-4457-a441-e50af408f4b8 None None] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:01:25.585712 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-1a4f3b31-339e-4457-a441-e50af408f4b8 None None] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Jul 04 10:01:25.586270 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 2/4] 10.222.0.79 () {54 vars in 930 bytes} [Mon Jul 4 10:01:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:01:25.649545 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-ed6ecc22-14b5-4726-a9ef-bbe59c4c2cf9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "name": "cirros256", "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:01:25.670439 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 10:01:25.670439 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: warnings.warn(msg) Jul 04 10:01:25.700352 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-ed6ecc22-14b5-4726-a9ef-bbe59c4c2cf9 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.107981 Jul 04 10:01:25.700922 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 3/5] 10.222.0.79 () {64 vars in 1282 bytes} [Mon Jul 4 10:01:25 2022] POST /compute/v2.1/flavors => generated 407 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 10:01:25.715396 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG dbcounter [-] [103347] Writing DB stats nova_api:SELECT=3 {{(pid=103347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:01:25.716877 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG dbcounter [-] [103347] Writing DB stats nova_cell0:SELECT=3 {{(pid=103347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:01:25.717855 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG dbcounter [-] [103347] Writing DB stats nova_cell1:SELECT=3 {{(pid=103347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:01:25.719369 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG dbcounter [-] [103347] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:01:25.926820 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-1c8e36b4-2404-44f5-9dc7-307163a728fe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:01:25.929324 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 10:01:25.929324 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: warnings.warn(msg) Jul 04 10:01:25.988330 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-1c8e36b4-2404-44f5-9dc7-307163a728fe admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.278719 Jul 04 10:01:25.989375 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 3/6] 10.222.0.79 () {64 vars in 1335 bytes} [Mon Jul 4 10:01:25 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:01:28.037363 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-ed6ecc22-14b5-4726-a9ef-bbe59c4c2cf9 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:01:28.038418 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-ed6ecc22-14b5-4726-a9ef-bbe59c4c2cf9 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Jul 04 10:01:28.038836 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 4/7] 10.222.0.79 () {54 vars in 930 bytes} [Mon Jul 4 10:01:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:01:28.153444 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-6f70a1c0-4ba4-4ec8-b596-9e7fed3522dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "swap": 0, "disk": 5, "rxtx_factor": 1.0, "id": "d1", "ram": 512, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:01:28.171254 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 10:01:28.171254 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: warnings.warn(msg) Jul 04 10:01:28.191997 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-6f70a1c0-4ba4-4ec8-b596-9e7fed3522dc admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.146926 Jul 04 10:01:28.192612 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 4/8] 10.222.0.79 () {64 vars in 1282 bytes} [Mon Jul 4 10:01:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 10:01:28.205154 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-9bb08437-fdc8-4309-9ed7-2d09093a76f9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:01:28.206703 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 10:01:28.206703 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: warnings.warn(msg) Jul 04 10:01:28.249963 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-9bb08437-fdc8-4309-9ed7-2d09093a76f9 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048649 Jul 04 10:01:28.250558 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 5/9] 10.222.0.79 () {64 vars in 1335 bytes} [Mon Jul 4 10:01:28 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:01:30.332935 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-6f70a1c0-4ba4-4ec8-b596-9e7fed3522dc admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:01:30.333997 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-6f70a1c0-4ba4-4ec8-b596-9e7fed3522dc admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jul 04 10:01:30.334399 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 5/10] 10.222.0.79 () {54 vars in 930 bytes} [Mon Jul 4 10:01:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:01:30.417309 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-19bab73d-264b-462e-aa6d-381533baf6e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "rxtx_factor": 1.0, "vcpus": 1, "ram": 1024, "swap": 0}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:01:30.436161 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-19bab73d-264b-462e-aa6d-381533baf6e2 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.095650 Jul 04 10:01:30.436900 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 6/11] 10.222.0.79 () {64 vars in 1282 bytes} [Mon Jul 4 10:01:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 10:01:30.448948 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-40132fbd-e4c8-4a21-844a-0e1a71439357 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:01:30.474160 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-40132fbd-e4c8-4a21-844a-0e1a71439357 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029078 Jul 04 10:01:30.475286 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 6/12] 10.222.0.79 () {64 vars in 1335 bytes} [Mon Jul 4 10:01:30 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:01:32.582603 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-19bab73d-264b-462e-aa6d-381533baf6e2 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:01:32.583656 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-19bab73d-264b-462e-aa6d-381533baf6e2 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jul 04 10:01:32.584079 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 7/13] 10.222.0.79 () {54 vars in 930 bytes} [Mon Jul 4 10:01:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:01:32.647293 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-9fef0c84-c548-4725-934b-51437e096503 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "os-flavor-access:is_public": true, "vcpus": 2, "ram": 2048, "name": "ds2G"}} {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:01:32.666748 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-9fef0c84-c548-4725-934b-51437e096503 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076685 Jul 04 10:01:32.667284 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 7/14] 10.222.0.79 () {64 vars in 1282 bytes} [Mon Jul 4 10:01:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 10:01:32.679210 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-42dcaa37-dd84-4783-8752-81931395a657 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:01:32.703990 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-42dcaa37-dd84-4783-8752-81931395a657 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028531 Jul 04 10:01:32.704579 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 8/15] 10.222.0.79 () {64 vars in 1335 bytes} [Mon Jul 4 10:01:32 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:01:34.772752 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-9fef0c84-c548-4725-934b-51437e096503 admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:01:34.773803 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-9fef0c84-c548-4725-934b-51437e096503 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jul 04 10:01:34.774193 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 8/16] 10.222.0.79 () {54 vars in 930 bytes} [Mon Jul 4 10:01:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:01:34.832669 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-ae254844-8a56-4abd-ad0b-5a4fa337fc23 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "vcpus": 4, "os-flavor-access:is_public": true, "id": "d4", "rxtx_factor": 1.0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:01:34.851623 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-ae254844-8a56-4abd-ad0b-5a4fa337fc23 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071255 Jul 04 10:01:34.852197 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 9/17] 10.222.0.79 () {64 vars in 1282 bytes} [Mon Jul 4 10:01:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 10:01:34.864636 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-c9dcf5cc-30d0-4823-b991-4dc5798254d8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:01:34.896046 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-c9dcf5cc-30d0-4823-b991-4dc5798254d8 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035133 Jul 04 10:01:34.897426 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 9/18] 10.222.0.79 () {64 vars in 1335 bytes} [Mon Jul 4 10:01:34 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:01:36.987050 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-ae254844-8a56-4abd-ad0b-5a4fa337fc23 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:01:36.988026 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-ae254844-8a56-4abd-ad0b-5a4fa337fc23 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jul 04 10:01:36.988745 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 10/19] 10.222.0.79 () {54 vars in 930 bytes} [Mon Jul 4 10:01:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:01:37.061833 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-afcdabc1-c0e6-46ff-9ade-7f9e2468b722 admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:01:37.089737 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-afcdabc1-c0e6-46ff-9ade-7f9e2468b722 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.091248 Jul 04 10:01:37.090323 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 10/20] 10.222.0.79 () {60 vars in 1291 bytes} [Mon Jul 4 10:01:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:01:39.208874 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-ae254844-8a56-4abd-ad0b-5a4fa337fc23 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:01:39.209883 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-ae254844-8a56-4abd-ad0b-5a4fa337fc23 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jul 04 10:01:39.210282 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 11/21] 10.222.0.79 () {54 vars in 930 bytes} [Mon Jul 4 10:01:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:01:39.268900 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-5a9a327d-639d-412d-9f18-a7cb30f69749 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 512, "id": "1", "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "swap": 0}} {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:01:39.288260 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-5a9a327d-639d-412d-9f18-a7cb30f69749 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.071385 Jul 04 10:01:39.289061 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 11/22] 10.222.0.79 () {64 vars in 1282 bytes} [Mon Jul 4 10:01:39 2022] POST /compute/v2.1/flavors => generated 402 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 10:01:39.300972 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-e131a8c3-67f1-4c67-9252-a120e426d9b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:01:39.325201 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-e131a8c3-67f1-4c67-9252-a120e426d9b5 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027866 Jul 04 10:01:39.325898 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 12/23] 10.222.0.79 () {64 vars in 1332 bytes} [Mon Jul 4 10:01:39 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:01:41.403028 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-5a9a327d-639d-412d-9f18-a7cb30f69749 admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:01:41.403967 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-5a9a327d-639d-412d-9f18-a7cb30f69749 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jul 04 10:01:41.404361 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 12/24] 10.222.0.79 () {54 vars in 930 bytes} [Mon Jul 4 10:01:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:01:41.482164 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-61490f6b-cdc8-4e93-b807-e041dc624f7e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 20, "name": "m1.small", "rxtx_factor": 1.0, "id": "2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:01:41.501812 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-61490f6b-cdc8-4e93-b807-e041dc624f7e admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.091254 Jul 04 10:01:41.502368 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 13/25] 10.222.0.79 () {64 vars in 1282 bytes} [Mon Jul 4 10:01:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 04 10:01:41.516947 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-81136a87-a3ae-4383-a5aa-15147a7bb071 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:01:41.542955 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-81136a87-a3ae-4383-a5aa-15147a7bb071 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029967 Jul 04 10:01:41.543753 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 13/26] 10.222.0.79 () {64 vars in 1332 bytes} [Mon Jul 4 10:01:41 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:01:43.618826 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-61490f6b-cdc8-4e93-b807-e041dc624f7e admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:01:43.619982 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-61490f6b-cdc8-4e93-b807-e041dc624f7e admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001733 Jul 04 10:01:43.620438 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 14/27] 10.222.0.79 () {54 vars in 930 bytes} [Mon Jul 4 10:01:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:01:43.683558 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-bac2e4fe-2cb4-4864-95ea-0f361f2e5c2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "disk": 40, "id": "3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "rxtx_factor": 1.0, "swap": 0}} {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:01:43.703349 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-bac2e4fe-2cb4-4864-95ea-0f361f2e5c2c admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.075589 Jul 04 10:01:43.703913 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 14/28] 10.222.0.79 () {64 vars in 1282 bytes} [Mon Jul 4 10:01:43 2022] POST /compute/v2.1/flavors => generated 406 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 10:01:43.719949 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-46f4fa7c-e896-404e-b386-86cb6544ceab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:01:43.747558 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-46f4fa7c-e896-404e-b386-86cb6544ceab admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032976 Jul 04 10:01:43.748219 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 15/29] 10.222.0.79 () {64 vars in 1332 bytes} [Mon Jul 4 10:01:43 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:01:45.784103 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-bac2e4fe-2cb4-4864-95ea-0f361f2e5c2c admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:01:45.785122 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-bac2e4fe-2cb4-4864-95ea-0f361f2e5c2c admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jul 04 10:01:45.785556 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 15/30] 10.222.0.79 () {54 vars in 930 bytes} [Mon Jul 4 10:01:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:01:45.846643 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-89918e30-4015-40cf-b42e-8f650ff6a84a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "disk": 80, "ram": 8192, "name": "m1.large"}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:01:45.865157 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-89918e30-4015-40cf-b42e-8f650ff6a84a admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073644 Jul 04 10:01:45.865718 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 16/31] 10.222.0.79 () {64 vars in 1282 bytes} [Mon Jul 4 10:01:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 10:01:45.878010 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-2dd59f7e-2ca6-45bc-bf2e-a34acb1aa959 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:01:45.903037 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-2dd59f7e-2ca6-45bc-bf2e-a34acb1aa959 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028835 Jul 04 10:01:45.903584 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 16/32] 10.222.0.79 () {64 vars in 1332 bytes} [Mon Jul 4 10:01:45 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:01:47.999728 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-89918e30-4015-40cf-b42e-8f650ff6a84a admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:01:48.001682 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-89918e30-4015-40cf-b42e-8f650ff6a84a admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002336 Jul 04 10:01:48.003648 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 17/33] 10.222.0.79 () {54 vars in 930 bytes} [Mon Jul 4 10:01:47 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:01:48.065650 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-191eae8a-837b-42a7-8dcb-7de7d717a76b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "vcpus": 8, "ram": 16384, "rxtx_factor": 1.0, "id": "5", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160}} {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:01:48.085704 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-191eae8a-837b-42a7-8dcb-7de7d717a76b admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.076847 Jul 04 10:01:48.086556 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 17/34] 10.222.0.79 () {64 vars in 1282 bytes} [Mon Jul 4 10:01:48 2022] POST /compute/v2.1/flavors => generated 408 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 10:01:48.099962 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-0b1c28da-ff6a-422b-ad9a-0861dae8a001 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:01:48.126768 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-0b1c28da-ff6a-422b-ad9a-0861dae8a001 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031411 Jul 04 10:01:48.127798 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 18/35] 10.222.0.79 () {64 vars in 1332 bytes} [Mon Jul 4 10:01:48 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:02:12.845857 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-191eae8a-837b-42a7-8dcb-7de7d717a76b admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:02:12.846906 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-191eae8a-837b-42a7-8dcb-7de7d717a76b admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Jul 04 10:02:12.847301 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 18/36] 10.222.0.79 () {54 vars in 930 bytes} [Mon Jul 4 10:02:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:02:12.862101 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:02:12.933818 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-45e9b883-f6bd-40f0-b43d-d418cdda4663 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:02:12.955552 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-45e9b883-f6bd-40f0-b43d-d418cdda4663 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.100166 Jul 04 10:02:12.956094 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 19/37] 10.222.0.79 () {60 vars in 1291 bytes} [Mon Jul 4 10:02:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:02:13.915742 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-191eae8a-837b-42a7-8dcb-7de7d717a76b admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:02:13.916749 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-191eae8a-837b-42a7-8dcb-7de7d717a76b admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001593 Jul 04 10:02:13.917136 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 19/38] 10.222.0.79 () {56 vars in 1074 bytes} [Mon Jul 4 10:02:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:02:14.110476 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-85774f4f-9342-4fac-89d2-5ea9ac556384 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:02:14.116504 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.wsgi [None req-85774f4f-9342-4fac-89d2-5ea9ac556384 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 04 10:02:14.119857 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-85774f4f-9342-4fac-89d2-5ea9ac556384 admin admin] Request method failure captured: Jul 04 10:02:14.119857 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 04 10:02:14.119857 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: Accept: application/json Jul 04 10:02:14.119857 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: Accept-Encoding: gzip, deflate Jul 04 10:02:14.119857 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: Connection: keep-alive Jul 04 10:02:14.119857 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: Content-Length: 0 Jul 04 10:02:14.119857 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: Host: 10.222.0.79 Jul 04 10:02:14.119857 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: Openstack-Api-Version: compute 2.90 Jul 04 10:02:14.119857 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: Openstack-System-Scope: None Jul 04 10:02:14.119857 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: User-Agent: python-novaclient Jul 04 10:02:14.119857 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Auth-Token: gAAAAABiwrqlirLiC__RM46n3pGhYqMrIkLAoLFm3e3Je1_y7DQr7SMegEfEnDCbz6iHkpr1t-xdASqD0--8s8Bm7NM9Dv8LBmuQPej5RMUK2FzBAYGtqGfUy76aDWXBDUqYY87nAHwVVOdxdC6pDSC_sKLtXBTV8J91miUUuWpNZn5HV-xQiP8 Jul 04 10:02:14.119857 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Domain-Id: None Jul 04 10:02:14.119857 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Domain-Name: None Jul 04 10:02:14.119857 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Identity-Status: Confirmed Jul 04 10:02:14.119857 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Is-Admin-Project: True Jul 04 10:02:14.119857 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Openstack-Nova-Api-Version: 2.90 Jul 04 10:02:14.119857 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Project-Domain-Id: default Jul 04 10:02:14.119857 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Project-Domain-Name: Default Jul 04 10:02:14.119857 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Project-Id: ca4e68f3b1bd4167b76136fe537c9f10 Jul 04 10:02:14.119857 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Project-Name: admin Jul 04 10:02:14.119857 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Role: reader,admin,member Jul 04 10:02:14.119857 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Roles: reader,admin,member Jul 04 10:02:14.121420 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ca4e68f3b1bd4167b76136fe537c9f10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ca4e68f3b1bd4167b76136fe537c9f10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca4e68f3b1bd4167b76136fe537c9f10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca4e68f3b1bd4167b76136fe537c9f10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:02:14.121420 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Tenant: admin Jul 04 10:02:14.121420 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Tenant-Id: ca4e68f3b1bd4167b76136fe537c9f10 Jul 04 10:02:14.121420 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Tenant-Name: admin Jul 04 10:02:14.121420 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-User: admin Jul 04 10:02:14.121420 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-User-Domain-Id: default Jul 04 10:02:14.121420 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-User-Domain-Name: Default Jul 04 10:02:14.121420 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-User-Id: 5875b90a72824e1280ee921aaccb7829 Jul 04 10:02:14.121420 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-User-Name: admin Jul 04 10:02:14.121420 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: method: > Jul 04 10:02:14.121420 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: exception: Flavor 42 could not be found. Jul 04 10:02:14.121420 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: action_args: {'id': '42'} Jul 04 10:02:14.121420 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:02:14.121420 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:02:14.122373 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 04 10:02:14.122373 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 04 10:02:14.122373 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 04 10:02:14.122373 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 04 10:02:14.122373 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 10:02:14.122373 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 10:02:14.122373 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 04 10:02:14.122373 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 04 10:02:14.122373 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 04 10:02:14.122373 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:02:14.122373 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 04 10:02:14.122373 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 04 10:02:14.122373 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 04 10:02:14.122373 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jul 04 10:02:14.122373 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:02:14.122373 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jul 04 10:02:14.122373 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:02:14.122373 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:02:14.122373 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:02:14.123903 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:02:14.123903 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:02:14.123903 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:02:14.123903 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:02:14.123903 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 04 10:02:14.123903 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:02:14.123903 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 04 10:02:14.123903 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jul 04 10:02:14.123903 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:02:14.123903 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jul 04 10:02:14.123903 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:02:14.123903 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:02:14.123903 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:02:14.123903 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:02:14.123903 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:02:14.123903 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 04 10:02:14.123903 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jul 04 10:02:14.123903 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-85774f4f-9342-4fac-89d2-5ea9ac556384 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:02:14.125285 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-85774f4f-9342-4fac-89d2-5ea9ac556384 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.066460 Jul 04 10:02:14.125920 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 20/39] 10.222.0.79 () {60 vars in 1190 bytes} [Mon Jul 4 10:02:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 04 10:02:14.131035 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-201f74bb-2a0f-49d5-8205-283209532af9 admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:02:14.134185 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG dbcounter [-] [103347] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:02:14.154167 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-201f74bb-2a0f-49d5-8205-283209532af9 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026782 Jul 04 10:02:14.154734 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 20/40] 10.222.0.79 () {60 vars in 1210 bytes} [Mon Jul 4 10:02:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:02:14.165100 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-7cea1bdd-0747-480e-a97e-cc0936903e62 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:02:14.187173 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-7cea1bdd-0747-480e-a97e-cc0936903e62 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025826 Jul 04 10:02:14.187718 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 21/41] 10.222.0.79 () {60 vars in 1210 bytes} [Mon Jul 4 10:02:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:02:14.199291 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-9812a8ef-b10b-4bde-92af-f0ffd81abd21 admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:02:14.205427 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.wsgi [None req-9812a8ef-b10b-4bde-92af-f0ffd81abd21 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 04 10:02:14.208858 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-9812a8ef-b10b-4bde-92af-f0ffd81abd21 admin admin] Request method failure captured: Jul 04 10:02:14.208858 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 04 10:02:14.208858 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: Accept: application/json Jul 04 10:02:14.208858 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: Accept-Encoding: gzip, deflate Jul 04 10:02:14.208858 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: Connection: keep-alive Jul 04 10:02:14.208858 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: Content-Length: 0 Jul 04 10:02:14.208858 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: Host: 10.222.0.79 Jul 04 10:02:14.208858 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: Openstack-Api-Version: compute 2.90 Jul 04 10:02:14.208858 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: Openstack-System-Scope: None Jul 04 10:02:14.208858 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: User-Agent: python-novaclient Jul 04 10:02:14.208858 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Auth-Token: gAAAAABiwrqlirLiC__RM46n3pGhYqMrIkLAoLFm3e3Je1_y7DQr7SMegEfEnDCbz6iHkpr1t-xdASqD0--8s8Bm7NM9Dv8LBmuQPej5RMUK2FzBAYGtqGfUy76aDWXBDUqYY87nAHwVVOdxdC6pDSC_sKLtXBTV8J91miUUuWpNZn5HV-xQiP8 Jul 04 10:02:14.208858 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Domain-Id: None Jul 04 10:02:14.208858 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Domain-Name: None Jul 04 10:02:14.208858 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Identity-Status: Confirmed Jul 04 10:02:14.208858 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Is-Admin-Project: True Jul 04 10:02:14.208858 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Openstack-Nova-Api-Version: 2.90 Jul 04 10:02:14.208858 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Project-Domain-Id: default Jul 04 10:02:14.208858 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Project-Domain-Name: Default Jul 04 10:02:14.208858 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Project-Id: ca4e68f3b1bd4167b76136fe537c9f10 Jul 04 10:02:14.208858 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Project-Name: admin Jul 04 10:02:14.208858 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Role: reader,admin,member Jul 04 10:02:14.208858 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Roles: reader,admin,member Jul 04 10:02:14.210411 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ca4e68f3b1bd4167b76136fe537c9f10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ca4e68f3b1bd4167b76136fe537c9f10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca4e68f3b1bd4167b76136fe537c9f10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca4e68f3b1bd4167b76136fe537c9f10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:02:14.210411 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Tenant: admin Jul 04 10:02:14.210411 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Tenant-Id: ca4e68f3b1bd4167b76136fe537c9f10 Jul 04 10:02:14.210411 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Tenant-Name: admin Jul 04 10:02:14.210411 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-User: admin Jul 04 10:02:14.210411 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-User-Domain-Id: default Jul 04 10:02:14.210411 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-User-Domain-Name: Default Jul 04 10:02:14.210411 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-User-Id: 5875b90a72824e1280ee921aaccb7829 Jul 04 10:02:14.210411 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-User-Name: admin Jul 04 10:02:14.210411 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: method: > Jul 04 10:02:14.210411 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: exception: Flavor 42 could not be found. Jul 04 10:02:14.210411 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: action_args: {'id': '42'} Jul 04 10:02:14.210411 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:02:14.210411 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:02:14.211415 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 04 10:02:14.211415 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 04 10:02:14.211415 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 04 10:02:14.211415 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 04 10:02:14.211415 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 10:02:14.211415 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 10:02:14.211415 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 04 10:02:14.211415 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 04 10:02:14.211415 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 04 10:02:14.211415 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:02:14.211415 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 04 10:02:14.211415 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 04 10:02:14.211415 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 04 10:02:14.211415 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Jul 04 10:02:14.211415 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:02:14.211415 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Jul 04 10:02:14.211415 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:02:14.211415 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:02:14.211415 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:02:14.212609 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:02:14.212609 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:02:14.212609 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:02:14.212609 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:02:14.212609 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 04 10:02:14.212609 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:02:14.212609 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 04 10:02:14.212609 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Jul 04 10:02:14.212609 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:02:14.212609 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Jul 04 10:02:14.212609 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:02:14.212609 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:02:14.212609 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:02:14.212609 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:02:14.212609 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:02:14.212609 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 04 10:02:14.212609 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Jul 04 10:02:14.212609 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-9812a8ef-b10b-4bde-92af-f0ffd81abd21 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103347) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:02:14.213811 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-9812a8ef-b10b-4bde-92af-f0ffd81abd21 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016030 Jul 04 10:02:14.213811 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 21/42] 10.222.0.79 () {60 vars in 1190 bytes} [Mon Jul 4 10:02:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 04 10:02:15.046857 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-7cea1bdd-0747-480e-a97e-cc0936903e62 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:02:15.047910 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-7cea1bdd-0747-480e-a97e-cc0936903e62 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jul 04 10:02:15.048274 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 22/43] 10.222.0.79 () {56 vars in 1074 bytes} [Mon Jul 4 10:02:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:02:15.255742 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-414eb02f-8a6f-4e0a-89d0-d59aa45b212c admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:02:15.262212 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.wsgi [None req-414eb02f-8a6f-4e0a-89d0-d59aa45b212c admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 04 10:02:15.263747 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-414eb02f-8a6f-4e0a-89d0-d59aa45b212c admin admin] Request method failure captured: Jul 04 10:02:15.263747 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 04 10:02:15.263747 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: Accept: application/json Jul 04 10:02:15.263747 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: Accept-Encoding: gzip, deflate Jul 04 10:02:15.263747 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: Connection: keep-alive Jul 04 10:02:15.263747 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: Content-Length: 0 Jul 04 10:02:15.263747 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: Host: 10.222.0.79 Jul 04 10:02:15.263747 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: Openstack-Api-Version: compute 2.90 Jul 04 10:02:15.263747 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: Openstack-System-Scope: None Jul 04 10:02:15.263747 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: User-Agent: python-novaclient Jul 04 10:02:15.263747 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Auth-Token: gAAAAABiwrqntB29BgGEWqWpD4G9u612Sqmit-sPVJMNKTXx4A8cc-Ibt4y-CkrLe-_j2nzY8JPX_ltqJfKNdiZDvTfvVsCTVZkOsAwg63_5w4-Q4roUGVw-66MRsajLjZIrg1Z-QPa62oW02Sh-AKsDEaNGLIFwirnexq_9u9cML9-Z69m9Fy0 Jul 04 10:02:15.263747 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Domain-Id: None Jul 04 10:02:15.263747 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Domain-Name: None Jul 04 10:02:15.263747 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Identity-Status: Confirmed Jul 04 10:02:15.263747 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Is-Admin-Project: True Jul 04 10:02:15.263747 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Openstack-Nova-Api-Version: 2.90 Jul 04 10:02:15.263747 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Project-Domain-Id: default Jul 04 10:02:15.263747 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Project-Domain-Name: Default Jul 04 10:02:15.263747 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Project-Id: ca4e68f3b1bd4167b76136fe537c9f10 Jul 04 10:02:15.263747 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Project-Name: admin Jul 04 10:02:15.263747 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Role: reader,admin,member Jul 04 10:02:15.263747 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Roles: reader,admin,member Jul 04 10:02:15.265146 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ca4e68f3b1bd4167b76136fe537c9f10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ca4e68f3b1bd4167b76136fe537c9f10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca4e68f3b1bd4167b76136fe537c9f10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca4e68f3b1bd4167b76136fe537c9f10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:02:15.265146 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Tenant: admin Jul 04 10:02:15.265146 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Tenant-Id: ca4e68f3b1bd4167b76136fe537c9f10 Jul 04 10:02:15.265146 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Tenant-Name: admin Jul 04 10:02:15.265146 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-User: admin Jul 04 10:02:15.265146 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-User-Domain-Id: default Jul 04 10:02:15.265146 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-User-Domain-Name: Default Jul 04 10:02:15.265146 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-User-Id: 5875b90a72824e1280ee921aaccb7829 Jul 04 10:02:15.265146 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-User-Name: admin Jul 04 10:02:15.265146 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: method: > Jul 04 10:02:15.265146 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: exception: Flavor 84 could not be found. Jul 04 10:02:15.265146 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: action_args: {'id': '84'} Jul 04 10:02:15.265146 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:02:15.265146 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:02:15.266019 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 04 10:02:15.266019 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 04 10:02:15.266019 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 04 10:02:15.266019 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 04 10:02:15.266019 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 10:02:15.266019 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 10:02:15.266019 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 04 10:02:15.266019 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 04 10:02:15.266019 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 04 10:02:15.266019 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:02:15.266019 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 04 10:02:15.266019 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 04 10:02:15.266019 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 04 10:02:15.266019 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Jul 04 10:02:15.266019 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:02:15.266019 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Jul 04 10:02:15.266019 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:02:15.266019 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:02:15.266019 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:02:15.267045 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:02:15.267045 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:02:15.267045 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:02:15.267045 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:02:15.267045 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 04 10:02:15.267045 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:02:15.267045 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 04 10:02:15.267045 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Jul 04 10:02:15.267045 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:02:15.267045 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Jul 04 10:02:15.267045 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:02:15.267045 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:02:15.267045 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:02:15.267045 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:02:15.267045 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:02:15.267045 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 04 10:02:15.267045 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Jul 04 10:02:15.267045 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-414eb02f-8a6f-4e0a-89d0-d59aa45b212c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103347) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:02:15.268080 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-414eb02f-8a6f-4e0a-89d0-d59aa45b212c admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.073548 Jul 04 10:02:15.268080 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 22/44] 10.222.0.79 () {60 vars in 1190 bytes} [Mon Jul 4 10:02:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 04 10:02:15.277993 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-0c4dd145-439b-4d11-bc98-507cd51fd72b admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:02:15.292453 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-0c4dd145-439b-4d11-bc98-507cd51fd72b admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020142 Jul 04 10:02:15.292987 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 23/45] 10.222.0.79 () {60 vars in 1210 bytes} [Mon Jul 4 10:02:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:02:15.302401 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-1d90af60-c2b3-494d-a35f-dfb5ae14108f admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:02:15.316392 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-1d90af60-c2b3-494d-a35f-dfb5ae14108f admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017562 Jul 04 10:02:15.316907 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 23/46] 10.222.0.79 () {60 vars in 1210 bytes} [Mon Jul 4 10:02:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:02:15.326628 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-c148a367-44c3-49d1-989a-195c063bdd18 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:02:15.332025 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.wsgi [None req-c148a367-44c3-49d1-989a-195c063bdd18 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 04 10:02:15.333533 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-c148a367-44c3-49d1-989a-195c063bdd18 admin admin] Request method failure captured: Jul 04 10:02:15.333533 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 04 10:02:15.333533 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: Accept: application/json Jul 04 10:02:15.333533 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: Accept-Encoding: gzip, deflate Jul 04 10:02:15.333533 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: Connection: keep-alive Jul 04 10:02:15.333533 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: Content-Length: 0 Jul 04 10:02:15.333533 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: Host: 10.222.0.79 Jul 04 10:02:15.333533 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: Openstack-Api-Version: compute 2.90 Jul 04 10:02:15.333533 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: Openstack-System-Scope: None Jul 04 10:02:15.333533 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: User-Agent: python-novaclient Jul 04 10:02:15.333533 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Auth-Token: gAAAAABiwrqntB29BgGEWqWpD4G9u612Sqmit-sPVJMNKTXx4A8cc-Ibt4y-CkrLe-_j2nzY8JPX_ltqJfKNdiZDvTfvVsCTVZkOsAwg63_5w4-Q4roUGVw-66MRsajLjZIrg1Z-QPa62oW02Sh-AKsDEaNGLIFwirnexq_9u9cML9-Z69m9Fy0 Jul 04 10:02:15.333533 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Domain-Id: None Jul 04 10:02:15.333533 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Domain-Name: None Jul 04 10:02:15.333533 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Identity-Status: Confirmed Jul 04 10:02:15.333533 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Is-Admin-Project: True Jul 04 10:02:15.333533 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Openstack-Nova-Api-Version: 2.90 Jul 04 10:02:15.333533 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Project-Domain-Id: default Jul 04 10:02:15.333533 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Project-Domain-Name: Default Jul 04 10:02:15.333533 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Project-Id: ca4e68f3b1bd4167b76136fe537c9f10 Jul 04 10:02:15.333533 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Project-Name: admin Jul 04 10:02:15.333533 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Role: reader,admin,member Jul 04 10:02:15.333533 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Roles: reader,admin,member Jul 04 10:02:15.335060 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ca4e68f3b1bd4167b76136fe537c9f10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ca4e68f3b1bd4167b76136fe537c9f10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca4e68f3b1bd4167b76136fe537c9f10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca4e68f3b1bd4167b76136fe537c9f10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:02:15.335060 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Tenant: admin Jul 04 10:02:15.335060 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Tenant-Id: ca4e68f3b1bd4167b76136fe537c9f10 Jul 04 10:02:15.335060 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Tenant-Name: admin Jul 04 10:02:15.335060 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-User: admin Jul 04 10:02:15.335060 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-User-Domain-Id: default Jul 04 10:02:15.335060 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-User-Domain-Name: Default Jul 04 10:02:15.335060 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-User-Id: 5875b90a72824e1280ee921aaccb7829 Jul 04 10:02:15.335060 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-User-Name: admin Jul 04 10:02:15.335060 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: method: > Jul 04 10:02:15.335060 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: exception: Flavor 84 could not be found. Jul 04 10:02:15.335060 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: action_args: {'id': '84'} Jul 04 10:02:15.335060 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:02:15.335060 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:02:15.336020 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 04 10:02:15.336020 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 04 10:02:15.336020 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 04 10:02:15.336020 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 04 10:02:15.336020 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 10:02:15.336020 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 10:02:15.336020 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 04 10:02:15.336020 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 04 10:02:15.336020 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 04 10:02:15.336020 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:02:15.336020 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 04 10:02:15.336020 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 04 10:02:15.336020 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 04 10:02:15.336020 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jul 04 10:02:15.336020 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:02:15.336020 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jul 04 10:02:15.336020 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:02:15.336020 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:02:15.336020 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:02:15.337321 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:02:15.337321 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:02:15.337321 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:02:15.337321 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:02:15.337321 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 04 10:02:15.337321 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:02:15.337321 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 04 10:02:15.337321 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jul 04 10:02:15.337321 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:02:15.337321 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jul 04 10:02:15.337321 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:02:15.337321 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:02:15.337321 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:02:15.337321 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:02:15.337321 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:02:15.337321 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 04 10:02:15.337321 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jul 04 10:02:15.337321 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-c148a367-44c3-49d1-989a-195c063bdd18 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:02:15.338586 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-c148a367-44c3-49d1-989a-195c063bdd18 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012466 Jul 04 10:02:15.338586 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 24/47] 10.222.0.79 () {60 vars in 1190 bytes} [Mon Jul 4 10:02:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 04 10:02:16.151974 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-1d90af60-c2b3-494d-a35f-dfb5ae14108f admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:02:16.153244 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-1d90af60-c2b3-494d-a35f-dfb5ae14108f admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001676 Jul 04 10:02:16.153661 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 24/48] 10.222.0.79 () {56 vars in 1074 bytes} [Mon Jul 4 10:02:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:02:16.354919 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-0472de25-abf2-4163-92c9-c0c4d8cefbc3 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:02:16.361011 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.wsgi [None req-0472de25-abf2-4163-92c9-c0c4d8cefbc3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 04 10:02:16.362494 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-0472de25-abf2-4163-92c9-c0c4d8cefbc3 admin admin] Request method failure captured: Jul 04 10:02:16.362494 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 04 10:02:16.362494 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: Accept: application/json Jul 04 10:02:16.362494 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: Accept-Encoding: gzip, deflate Jul 04 10:02:16.362494 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: Connection: keep-alive Jul 04 10:02:16.362494 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: Content-Length: 0 Jul 04 10:02:16.362494 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: Host: 10.222.0.79 Jul 04 10:02:16.362494 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: Openstack-Api-Version: compute 2.90 Jul 04 10:02:16.362494 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: Openstack-System-Scope: None Jul 04 10:02:16.362494 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: User-Agent: python-novaclient Jul 04 10:02:16.362494 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Auth-Token: gAAAAABiwrqoLguJas8DF-XrfnYfMLIeMhT02VnRX1SY_fs5KgfhBfdggZkOoHX3iFpYyE-aDxHBeGKK5Ac-gNRqldkDo3HOGpcSodTcyh1wyKTdUzqhY-BNBV-1PChROIf3VUoPMepIhipmK85xXfjavnNWvV8e9Yy_oxqqXMb1OOlSUHtIOog Jul 04 10:02:16.362494 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Domain-Id: None Jul 04 10:02:16.362494 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Domain-Name: None Jul 04 10:02:16.362494 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Identity-Status: Confirmed Jul 04 10:02:16.362494 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Is-Admin-Project: True Jul 04 10:02:16.362494 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Openstack-Nova-Api-Version: 2.90 Jul 04 10:02:16.362494 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Project-Domain-Id: default Jul 04 10:02:16.362494 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Project-Domain-Name: Default Jul 04 10:02:16.362494 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Project-Id: ca4e68f3b1bd4167b76136fe537c9f10 Jul 04 10:02:16.362494 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Project-Name: admin Jul 04 10:02:16.362494 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Role: reader,admin,member Jul 04 10:02:16.362494 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Roles: reader,admin,member Jul 04 10:02:16.363895 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ca4e68f3b1bd4167b76136fe537c9f10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ca4e68f3b1bd4167b76136fe537c9f10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca4e68f3b1bd4167b76136fe537c9f10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca4e68f3b1bd4167b76136fe537c9f10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:02:16.363895 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Tenant: admin Jul 04 10:02:16.363895 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Tenant-Id: ca4e68f3b1bd4167b76136fe537c9f10 Jul 04 10:02:16.363895 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-Tenant-Name: admin Jul 04 10:02:16.363895 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-User: admin Jul 04 10:02:16.363895 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-User-Domain-Id: default Jul 04 10:02:16.363895 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-User-Domain-Name: Default Jul 04 10:02:16.363895 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-User-Id: 5875b90a72824e1280ee921aaccb7829 Jul 04 10:02:16.363895 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: X-User-Name: admin Jul 04 10:02:16.363895 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: method: > Jul 04 10:02:16.363895 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: exception: Flavor 451 could not be found. Jul 04 10:02:16.363895 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: action_args: {'id': '451'} Jul 04 10:02:16.363895 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:02:16.363895 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:02:16.364676 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 04 10:02:16.364676 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 04 10:02:16.364676 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 04 10:02:16.364676 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 04 10:02:16.364676 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 10:02:16.364676 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 10:02:16.364676 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 04 10:02:16.364676 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 04 10:02:16.364676 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 04 10:02:16.364676 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:02:16.364676 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 04 10:02:16.364676 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 04 10:02:16.364676 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 04 10:02:16.364676 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jul 04 10:02:16.364676 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:02:16.364676 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jul 04 10:02:16.364676 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:02:16.364676 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:02:16.364676 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:02:16.365753 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:02:16.365753 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:02:16.365753 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:02:16.365753 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:02:16.365753 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 04 10:02:16.365753 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:02:16.365753 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 04 10:02:16.365753 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jul 04 10:02:16.365753 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:02:16.365753 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jul 04 10:02:16.365753 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:02:16.365753 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:02:16.365753 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:02:16.365753 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:02:16.365753 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:02:16.365753 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 04 10:02:16.365753 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jul 04 10:02:16.365753 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-0472de25-abf2-4163-92c9-c0c4d8cefbc3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:02:16.366787 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-0472de25-abf2-4163-92c9-c0c4d8cefbc3 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.074330 Jul 04 10:02:16.366787 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 25/49] 10.222.0.79 () {60 vars in 1193 bytes} [Mon Jul 4 10:02:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 04 10:02:16.373849 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-1f09997f-cade-4a99-9ad7-f4099cf0c0c6 admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:02:16.387983 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-1f09997f-cade-4a99-9ad7-f4099cf0c0c6 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017752 Jul 04 10:02:16.388517 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 25/50] 10.222.0.79 () {60 vars in 1210 bytes} [Mon Jul 4 10:02:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:02:16.398088 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-0b1fddbf-4699-47d4-8a5c-2c4acd008df7 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:02:16.413428 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-0b1fddbf-4699-47d4-8a5c-2c4acd008df7 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018897 Jul 04 10:02:16.413996 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 26/51] 10.222.0.79 () {60 vars in 1210 bytes} [Mon Jul 4 10:02:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:02:16.423767 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-a1d2f0be-6f94-4b7d-a53d-b22e6a1a2daa admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:02:16.429523 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.wsgi [None req-a1d2f0be-6f94-4b7d-a53d-b22e6a1a2daa admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 04 10:02:16.431072 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-a1d2f0be-6f94-4b7d-a53d-b22e6a1a2daa admin admin] Request method failure captured: Jul 04 10:02:16.431072 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 04 10:02:16.431072 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: Accept: application/json Jul 04 10:02:16.431072 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: Accept-Encoding: gzip, deflate Jul 04 10:02:16.431072 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: Connection: keep-alive Jul 04 10:02:16.431072 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: Content-Length: 0 Jul 04 10:02:16.431072 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: Host: 10.222.0.79 Jul 04 10:02:16.431072 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: Openstack-Api-Version: compute 2.90 Jul 04 10:02:16.431072 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: Openstack-System-Scope: None Jul 04 10:02:16.431072 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: User-Agent: python-novaclient Jul 04 10:02:16.431072 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Auth-Token: gAAAAABiwrqoLguJas8DF-XrfnYfMLIeMhT02VnRX1SY_fs5KgfhBfdggZkOoHX3iFpYyE-aDxHBeGKK5Ac-gNRqldkDo3HOGpcSodTcyh1wyKTdUzqhY-BNBV-1PChROIf3VUoPMepIhipmK85xXfjavnNWvV8e9Yy_oxqqXMb1OOlSUHtIOog Jul 04 10:02:16.431072 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Domain-Id: None Jul 04 10:02:16.431072 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Domain-Name: None Jul 04 10:02:16.431072 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Identity-Status: Confirmed Jul 04 10:02:16.431072 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Is-Admin-Project: True Jul 04 10:02:16.431072 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Openstack-Nova-Api-Version: 2.90 Jul 04 10:02:16.431072 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Project-Domain-Id: default Jul 04 10:02:16.431072 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Project-Domain-Name: Default Jul 04 10:02:16.431072 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Project-Id: ca4e68f3b1bd4167b76136fe537c9f10 Jul 04 10:02:16.431072 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Project-Name: admin Jul 04 10:02:16.431072 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Role: reader,admin,member Jul 04 10:02:16.431072 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Roles: reader,admin,member Jul 04 10:02:16.432529 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ca4e68f3b1bd4167b76136fe537c9f10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ca4e68f3b1bd4167b76136fe537c9f10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca4e68f3b1bd4167b76136fe537c9f10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca4e68f3b1bd4167b76136fe537c9f10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:02:16.432529 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Tenant: admin Jul 04 10:02:16.432529 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Tenant-Id: ca4e68f3b1bd4167b76136fe537c9f10 Jul 04 10:02:16.432529 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-Tenant-Name: admin Jul 04 10:02:16.432529 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-User: admin Jul 04 10:02:16.432529 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-User-Domain-Id: default Jul 04 10:02:16.432529 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-User-Domain-Name: Default Jul 04 10:02:16.432529 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-User-Id: 5875b90a72824e1280ee921aaccb7829 Jul 04 10:02:16.432529 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: X-User-Name: admin Jul 04 10:02:16.432529 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: method: > Jul 04 10:02:16.432529 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: exception: Flavor 451 could not be found. Jul 04 10:02:16.432529 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: action_args: {'id': '451'} Jul 04 10:02:16.432529 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:02:16.432529 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:02:16.433682 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 04 10:02:16.433682 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 04 10:02:16.433682 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 04 10:02:16.433682 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 04 10:02:16.433682 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 10:02:16.433682 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 10:02:16.433682 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 04 10:02:16.433682 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 04 10:02:16.433682 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 04 10:02:16.433682 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:02:16.433682 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 04 10:02:16.433682 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 04 10:02:16.433682 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 04 10:02:16.433682 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Jul 04 10:02:16.433682 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:02:16.433682 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Jul 04 10:02:16.433682 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:02:16.433682 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:02:16.433682 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:02:16.435092 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:02:16.435092 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:02:16.435092 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:02:16.435092 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:02:16.435092 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 04 10:02:16.435092 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:02:16.435092 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 04 10:02:16.435092 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Jul 04 10:02:16.435092 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:02:16.435092 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Jul 04 10:02:16.435092 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:02:16.435092 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:02:16.435092 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:02:16.435092 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:02:16.435092 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:02:16.435092 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 04 10:02:16.435092 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Jul 04 10:02:16.435092 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-a1d2f0be-6f94-4b7d-a53d-b22e6a1a2daa admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103347) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:02:16.436317 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-a1d2f0be-6f94-4b7d-a53d-b22e6a1a2daa admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012442 Jul 04 10:02:16.436317 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 26/52] 10.222.0.79 () {60 vars in 1193 bytes} [Mon Jul 4 10:02:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 04 10:02:17.259133 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-0b1fddbf-4699-47d4-8a5c-2c4acd008df7 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:02:17.260241 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-0b1fddbf-4699-47d4-8a5c-2c4acd008df7 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jul 04 10:02:17.260665 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 27/53] 10.222.0.79 () {56 vars in 1074 bytes} [Mon Jul 4 10:02:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:02:17.468356 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-a6a2486a-55a2-4bd1-b5d0-d7a44dd9c727 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:02:17.491740 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-a6a2486a-55a2-4bd1-b5d0-d7a44dd9c727 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.091388 Jul 04 10:02:17.492279 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 27/54] 10.222.0.79 () {64 vars in 1235 bytes} [Mon Jul 4 10:02:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 10:02:18.333150 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-0b1fddbf-4699-47d4-8a5c-2c4acd008df7 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:02:18.334262 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-0b1fddbf-4699-47d4-8a5c-2c4acd008df7 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Jul 04 10:02:18.334649 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 28/55] 10.222.0.79 () {56 vars in 1074 bytes} [Mon Jul 4 10:02:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:02:18.549169 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-31fc5c37-a904-47ab-bb16-c8a951e84c15 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:02:18.571577 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-31fc5c37-a904-47ab-bb16-c8a951e84c15 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.080502 Jul 04 10:02:18.572096 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 28/56] 10.222.0.79 () {64 vars in 1235 bytes} [Mon Jul 4 10:02:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 10:02:19.396877 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-0b1fddbf-4699-47d4-8a5c-2c4acd008df7 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:02:19.397993 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-0b1fddbf-4699-47d4-8a5c-2c4acd008df7 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Jul 04 10:02:19.398382 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 29/57] 10.222.0.79 () {56 vars in 1074 bytes} [Mon Jul 4 10:02:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:02:19.594740 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-0cbf0a0d-087e-4cf0-8db0-2545b0112f7e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:02:19.615568 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-0cbf0a0d-087e-4cf0-8db0-2545b0112f7e admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.079768 Jul 04 10:02:19.616097 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 29/58] 10.222.0.79 () {64 vars in 1235 bytes} [Mon Jul 4 10:02:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 10:02:20.433987 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-0b1fddbf-4699-47d4-8a5c-2c4acd008df7 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:02:20.434985 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-0b1fddbf-4699-47d4-8a5c-2c4acd008df7 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jul 04 10:02:20.435374 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 30/59] 10.222.0.79 () {56 vars in 1074 bytes} [Mon Jul 4 10:02:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:02:20.640698 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-ea7dbb5c-07bd-41ef-9fbc-473e51a03c2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:02:20.664168 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-ea7dbb5c-07bd-41ef-9fbc-473e51a03c2b admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.092489 Jul 04 10:02:20.664780 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 30/60] 10.222.0.79 () {64 vars in 1235 bytes} [Mon Jul 4 10:02:20 2022] POST /compute/v2.1/flavors => generated 409 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 10:02:21.509455 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-0b1fddbf-4699-47d4-8a5c-2c4acd008df7 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:02:21.510721 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-0b1fddbf-4699-47d4-8a5c-2c4acd008df7 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002019 Jul 04 10:02:21.511253 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 31/61] 10.222.0.79 () {56 vars in 1074 bytes} [Mon Jul 4 10:02:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:02:21.731123 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-8c2a3ce6-765c-4ae6-82d0-b13645df5cf4 admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:02:21.750279 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-8c2a3ce6-765c-4ae6-82d0-b13645df5cf4 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.092841 Jul 04 10:02:21.750815 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 31/62] 10.222.0.79 () {60 vars in 1202 bytes} [Mon Jul 4 10:02:21 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:03:08.735674 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-0b1fddbf-4699-47d4-8a5c-2c4acd008df7 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:03:08.736681 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-0b1fddbf-4699-47d4-8a5c-2c4acd008df7 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002780 Jul 04 10:03:08.737127 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 32/63] 10.222.0.79 () {54 vars in 930 bytes} [Mon Jul 4 10:03:08 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:03:08.748080 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG dbcounter [-] [103347] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:03:08.800460 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-db72b988-747b-4243-b1cb-6d462bae0063 admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:03:08.827501 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-db72b988-747b-4243-b1cb-6d462bae0063 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.084210 Jul 04 10:03:08.828050 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 32/64] 10.222.0.79 () {60 vars in 1291 bytes} [Mon Jul 4 10:03:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:03:08.854099 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-855280b9-7fbd-4563-a613-577d72590d9d admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:03:08.858215 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_api:SELECT=14 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:03:08.863680 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-855280b9-7fbd-4563-a613-577d72590d9d admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015494 Jul 04 10:03:08.864226 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 33/65] 10.222.0.79 () {60 vars in 1282 bytes} [Mon Jul 4 10:03:08 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:03:08.875838 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-d67ecef2-0732-476e-9bef-6b8540b3ffd9 admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:03:08.883538 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-d67ecef2-0732-476e-9bef-6b8540b3ffd9 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011311 Jul 04 10:03:08.884040 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 33/66] 10.222.0.79 () {60 vars in 1285 bytes} [Mon Jul 4 10:03:08 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:03:08.895658 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-4efcaedb-f670-4c1d-b669-072e484715cd admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:03:08.903614 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-4efcaedb-f670-4c1d-b669-072e484715cd admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011765 Jul 04 10:03:08.904128 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 34/67] 10.222.0.79 () {60 vars in 1285 bytes} [Mon Jul 4 10:03:08 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:03:08.914988 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-dd569943-d6ce-44d2-9e2f-4f507df350b7 admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:03:08.922696 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-dd569943-d6ce-44d2-9e2f-4f507df350b7 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011210 Jul 04 10:03:08.923194 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 34/68] 10.222.0.79 () {60 vars in 1282 bytes} [Mon Jul 4 10:03:08 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:06:26.833071 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-4efcaedb-f670-4c1d-b669-072e484715cd admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:06:26.834108 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-4efcaedb-f670-4c1d-b669-072e484715cd admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jul 04 10:06:26.834497 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 35/69] 10.222.0.79 () {56 vars in 1074 bytes} [Mon Jul 4 10:06:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:06:26.973731 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG dbcounter [-] [103347] Writing DB stats nova_api:SELECT=6 {{(pid=103347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:06:27.108892 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-8fd9827d-b7f5-4751-b653-3a089eecc49c admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:06:27.110119 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 10:06:27.110119 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: warnings.warn(msg) Jul 04 10:06:27.111315 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG oslo_concurrency.lockutils [None req-8fd9827d-b7f5-4751-b653-3a089eecc49c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:06:27.111956 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG oslo_concurrency.lockutils [None req-8fd9827d-b7f5-4751-b653-3a089eecc49c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:06:27.112741 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG oslo_concurrency.lockutils [None req-8fd9827d-b7f5-4751-b653-3a089eecc49c admin admin] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:06:27.113156 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG oslo_concurrency.lockutils [None req-8fd9827d-b7f5-4751-b653-3a089eecc49c admin admin] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:06:27.151613 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-8fd9827d-b7f5-4751-b653-3a089eecc49c admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.179650 Jul 04 10:06:27.152226 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 35/70] 10.222.0.79 () {60 vars in 1193 bytes} [Mon Jul 4 10:06:26 2022] GET /compute/v2.1/os-services => generated 791 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 10:06:28.012362 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-4efcaedb-f670-4c1d-b669-072e484715cd admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:06:28.013362 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-4efcaedb-f670-4c1d-b669-072e484715cd admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jul 04 10:06:28.013779 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 36/71] 10.222.0.79 () {56 vars in 1074 bytes} [Mon Jul 4 10:06:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:06:28.206722 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-7866b898-1442-4380-b511-ed76214d9987 admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:06:28.208595 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 10:06:28.208595 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: warnings.warn(msg) Jul 04 10:06:28.210188 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG oslo_concurrency.lockutils [None req-7866b898-1442-4380-b511-ed76214d9987 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:06:28.210697 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG oslo_concurrency.lockutils [None req-7866b898-1442-4380-b511-ed76214d9987 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:06:28.211460 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG oslo_concurrency.lockutils [None req-7866b898-1442-4380-b511-ed76214d9987 admin admin] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:06:28.211885 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG oslo_concurrency.lockutils [None req-7866b898-1442-4380-b511-ed76214d9987 admin admin] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:06:28.231938 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-7866b898-1442-4380-b511-ed76214d9987 admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078149 Jul 04 10:06:28.232489 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 36/72] 10.222.0.79 () {60 vars in 1193 bytes} [Mon Jul 4 10:06:28 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 10:06:39.494394 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-4efcaedb-f670-4c1d-b669-072e484715cd admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:06:39.495402 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-4efcaedb-f670-4c1d-b669-072e484715cd admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jul 04 10:06:39.495788 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 37/73] 10.222.0.79 () {56 vars in 1074 bytes} [Mon Jul 4 10:06:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:06:39.641707 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG dbcounter [-] [103347] Writing DB stats nova_cell0:SELECT=4 {{(pid=103347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:06:39.642857 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG dbcounter [-] [103347] Writing DB stats nova_cell1:SELECT=4 {{(pid=103347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:06:39.643741 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG dbcounter [-] [103347] Writing DB stats nova_api:SELECT=8 {{(pid=103347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:06:39.693323 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-60896abb-ea37-4299-82b4-a090965612a0 admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:06:39.694574 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 10:06:39.694574 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: warnings.warn(msg) Jul 04 10:06:39.695702 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG oslo_concurrency.lockutils [None req-60896abb-ea37-4299-82b4-a090965612a0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:06:39.696137 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG oslo_concurrency.lockutils [None req-60896abb-ea37-4299-82b4-a090965612a0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:06:39.696915 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG oslo_concurrency.lockutils [None req-60896abb-ea37-4299-82b4-a090965612a0 admin admin] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:06:39.697337 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG oslo_concurrency.lockutils [None req-60896abb-ea37-4299-82b4-a090965612a0 admin admin] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:06:39.722593 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-60896abb-ea37-4299-82b4-a090965612a0 admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.088392 Jul 04 10:06:39.723133 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 37/74] 10.222.0.79 () {60 vars in 1193 bytes} [Mon Jul 4 10:06:39 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:06:40.546893 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-4efcaedb-f670-4c1d-b669-072e484715cd admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:06:40.547911 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-4efcaedb-f670-4c1d-b669-072e484715cd admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jul 04 10:06:40.548295 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 38/75] 10.222.0.79 () {56 vars in 1074 bytes} [Mon Jul 4 10:06:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:06:40.750817 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-c13eee56-7f53-44f2-baf1-6231e8825908 admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:06:40.752076 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 10:06:40.752076 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: warnings.warn(msg) Jul 04 10:06:40.753287 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG oslo_concurrency.lockutils [None req-c13eee56-7f53-44f2-baf1-6231e8825908 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:06:40.753760 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG oslo_concurrency.lockutils [None req-c13eee56-7f53-44f2-baf1-6231e8825908 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:06:40.754551 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG oslo_concurrency.lockutils [None req-c13eee56-7f53-44f2-baf1-6231e8825908 admin admin] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:06:40.754974 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: DEBUG oslo_concurrency.lockutils [None req-c13eee56-7f53-44f2-baf1-6231e8825908 admin admin] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:06:40.777154 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-c13eee56-7f53-44f2-baf1-6231e8825908 admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.092116 Jul 04 10:06:40.777742 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 38/76] 10.222.0.79 () {60 vars in 1193 bytes} [Mon Jul 4 10:06:40 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:07:36.776358 dv-cinder-848418-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 04 10:07:36.776897 dv-cinder-848418-1-iscsi devstack@n-api.service[103346]: Mon Jul 4 10:07:36 2022 - graceful shutdown triggered... Jul 04 10:07:36.777353 dv-cinder-848418-1-iscsi devstack@n-api.service[103347]: Gracefully killing worker 1 (pid: 103347)... Jul 04 10:07:36.777810 dv-cinder-848418-1-iscsi devstack@n-api.service[103348]: Gracefully killing worker 2 (pid: 103348)... Jul 04 10:07:37.777463 dv-cinder-848418-1-iscsi devstack@n-api.service[103346]: worker 1 buried after 1 seconds Jul 04 10:07:37.777463 dv-cinder-848418-1-iscsi devstack@n-api.service[103346]: worker 2 buried after 1 seconds Jul 04 10:07:37.777463 dv-cinder-848418-1-iscsi devstack@n-api.service[103346]: goodbye to uWSGI. Jul 04 10:07:37.779882 dv-cinder-848418-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 04 10:07:37.780812 dv-cinder-848418-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 04 10:07:37.785557 dv-cinder-848418-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 04 10:07:37.799918 dv-cinder-848418-1-iscsi devstack@n-api.service[117848]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 04 10:07:37.801974 dv-cinder-848418-1-iscsi devstack@n-api.service[117848]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 4 10:07:37 2022] *** Jul 04 10:07:37.801974 dv-cinder-848418-1-iscsi devstack@n-api.service[117848]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 04 10:07:37.801974 dv-cinder-848418-1-iscsi devstack@n-api.service[117848]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 04 10:07:37.801974 dv-cinder-848418-1-iscsi devstack@n-api.service[117848]: nodename: dv-cinder-848418-1-iscsi Jul 04 10:07:37.801974 dv-cinder-848418-1-iscsi devstack@n-api.service[117848]: machine: x86_64 Jul 04 10:07:37.801974 dv-cinder-848418-1-iscsi devstack@n-api.service[117848]: clock source: unix Jul 04 10:07:37.801974 dv-cinder-848418-1-iscsi devstack@n-api.service[117848]: pcre jit disabled Jul 04 10:07:37.801974 dv-cinder-848418-1-iscsi devstack@n-api.service[117848]: detected number of CPU cores: 4 Jul 04 10:07:37.801974 dv-cinder-848418-1-iscsi devstack@n-api.service[117848]: current working directory: / Jul 04 10:07:37.801974 dv-cinder-848418-1-iscsi devstack@n-api.service[117848]: detected binary path: /usr/bin/uwsgi-core Jul 04 10:07:37.801974 dv-cinder-848418-1-iscsi devstack@n-api.service[117848]: your processes number limit is 47680 Jul 04 10:07:37.802680 dv-cinder-848418-1-iscsi devstack@n-api.service[117848]: your memory page size is 4096 bytes Jul 04 10:07:37.802680 dv-cinder-848418-1-iscsi devstack@n-api.service[117848]: detected max file descriptor number: 2048 Jul 04 10:07:37.802680 dv-cinder-848418-1-iscsi devstack@n-api.service[117848]: lock engine: pthread robust mutexes Jul 04 10:07:37.802680 dv-cinder-848418-1-iscsi devstack@n-api.service[117848]: thunder lock: enabled Jul 04 10:07:37.802680 dv-cinder-848418-1-iscsi devstack@n-api.service[117848]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 04 10:07:37.802680 dv-cinder-848418-1-iscsi devstack@n-api.service[117848]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 04 10:07:37.847421 dv-cinder-848418-1-iscsi devstack@n-api.service[117848]: Python main interpreter initialized at 0x5646002849c0 Jul 04 10:07:37.847421 dv-cinder-848418-1-iscsi devstack@n-api.service[117848]: python threads support enabled Jul 04 10:07:37.847421 dv-cinder-848418-1-iscsi devstack@n-api.service[117848]: your server socket listen backlog is limited to 100 connections Jul 04 10:07:37.847421 dv-cinder-848418-1-iscsi devstack@n-api.service[117848]: your mercy for graceful operations on workers is 90 seconds Jul 04 10:07:37.847901 dv-cinder-848418-1-iscsi devstack@n-api.service[117848]: mapped 403077 bytes (393 KB) for 2 cores Jul 04 10:07:37.847901 dv-cinder-848418-1-iscsi devstack@n-api.service[117848]: *** Operational MODE: preforking *** Jul 04 10:07:37.848169 dv-cinder-848418-1-iscsi devstack@n-api.service[117848]: *** uWSGI is running in multiple interpreter mode *** Jul 04 10:07:37.848169 dv-cinder-848418-1-iscsi devstack@n-api.service[117848]: spawned uWSGI master process (pid: 117848) Jul 04 10:07:37.848396 dv-cinder-848418-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 04 10:07:37.849370 dv-cinder-848418-1-iscsi devstack@n-api.service[117848]: spawned uWSGI worker 1 (pid: 117865, cores: 1) Jul 04 10:07:37.849370 dv-cinder-848418-1-iscsi devstack@n-api.service[117848]: spawned uWSGI worker 2 (pid: 117866, cores: 1) Jul 04 10:07:37.849592 dv-cinder-848418-1-iscsi devstack@n-api.service[117848]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 04 10:07:38.501063 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 04 10:07:38.513327 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 04 10:07:39.675871 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 10:07:39.675871 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: from cryptography.utils import int_from_bytes Jul 04 10:07:39.676563 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 10:07:39.676563 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: from cryptography.utils import int_from_bytes Jul 04 10:07:39.707729 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 10:07:39.707729 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: from cryptography.utils import int_from_bytes Jul 04 10:07:39.708344 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 10:07:39.708344 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: from cryptography.utils import int_from_bytes Jul 04 10:07:42.073815 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 04 10:07:42.074445 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 04 10:07:42.074636 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 04 10:07:42.074968 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 04 10:07:42.075217 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 04 10:07:42.075598 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.075919 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.076238 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.076551 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.076877 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.077179 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.077496 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.077842 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.078165 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.078420 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.078729 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.079048 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848418-1-iscsi {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.079363 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.079870 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.080075 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.080337 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.080636 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.080948 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.081248 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.081784 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.083164 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.083164 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.083164 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.083164 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.083562 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.083882 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.084185 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.084485 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.084809 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.085111 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.085512 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848418-1-iscsi {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.085861 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.086166 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.086463 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.086885 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.087194 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.087495 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.087810 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.088128 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.088431 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.088752 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.089067 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.089382 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.089720 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.090017 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.090322 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.090627 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.090942 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.091242 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.091541 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.091783 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.092084 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.092396 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.092708 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.093023 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.093267 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.093511 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.093852 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.094168 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.094570 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.094834 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.096180 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.096180 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.096180 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.096885 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.096885 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.097170 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.097586 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.097812 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.098015 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.098319 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.098633 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.099038 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.099286 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.099591 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.100890 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.100890 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.100890 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.100890 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.101434 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.101434 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.102544 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.102544 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.102544 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.103043 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.103043 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.103350 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.103496 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.103873 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.104023 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.104288 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.104615 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.105114 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.105292 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.105463 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.105787 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.106085 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.106385 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.106685 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.106964 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.107281 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.107553 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.107880 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.108174 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.108481 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.108753 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.109081 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.109376 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.109672 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.110019 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.110316 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.110595 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.111151 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.111461 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.111773 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.112105 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.112412 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.112718 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.113032 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.113334 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.113664 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.113976 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.114278 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.114578 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.114750 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 04 10:07:42.115359 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.115515 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 04 10:07:42.115668 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.115668 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.115961 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 04 10:07:42.116111 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.116267 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 04 10:07:42.116418 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.116572 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 04 10:07:42.116724 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.116875 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.117019 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.117188 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.117334 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.117476 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.117643 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.117795 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.117967 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.118124 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.118282 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.118426 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.118578 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.118730 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.118882 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.119026 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.119179 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.119334 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.119478 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.119621 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.119776 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.119920 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.120070 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.120226 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848418-1-iscsi {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.120379 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.120543 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.120694 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.120845 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.121013 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.121185 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.121999 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.122122 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.122200 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.122282 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.122363 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.122436 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.122518 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.122604 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.122685 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.122685 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.122824 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.122922 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.123006 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.123078 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.123156 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.123228 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.123298 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.123524 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.123733 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.123826 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.123910 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.124135 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.124286 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.124397 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.124488 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.124706 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.124821 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.125057 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.125193 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.125330 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.125425 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.125661 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.125787 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848418-1-iscsi {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.126010 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.126156 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.126347 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.126485 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.126663 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.126770 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.126982 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.127330 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.127425 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.127644 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.127739 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.127956 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.128068 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.128273 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.128376 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.128593 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.128680 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.128900 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.129001 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.129221 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.129318 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.129528 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.129646 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.138008 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.138749 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.138857 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.138959 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.139056 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.139145 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.139248 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.139352 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.139440 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.139526 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.139618 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.139714 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.139810 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.139900 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.139994 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.140081 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.140173 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.140268 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.140367 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.140455 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.140541 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.140634 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.140721 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.140816 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.140910 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.141007 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.141096 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.141181 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.141267 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.141364 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.141460 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.141553 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.141679 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.141771 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.141878 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.141967 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.142103 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.142192 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.142277 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.142365 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.142465 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.142557 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.142647 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.142735 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.142827 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.142907 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.143008 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.143105 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.143192 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.143278 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.143365 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.143451 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.143550 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.143638 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.143731 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.143830 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.143927 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.144024 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.144111 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.144196 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.144288 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.144375 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.144461 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.144556 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.144652 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.144745 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.144832 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.144925 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.145019 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.145119 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.145214 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.145311 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.145399 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.145491 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.145584 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.149789 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.149889 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.149978 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.150054 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.150137 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.150221 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.150306 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.150379 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.150459 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.150538 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.150617 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.150698 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.150779 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.151128 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.151297 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.151297 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.151596 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.151740 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.151894 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.152048 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.152221 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.152368 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.152519 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.152672 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.152830 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.152977 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.153129 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.153275 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.153419 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.153574 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.153757 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.153905 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.154057 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.154202 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.154354 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.154506 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.154664 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.154818 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.154971 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.155123 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.155275 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.155434 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.155589 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.155741 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.155885 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.156039 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.156200 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.156359 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.156504 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.156649 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.156801 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.156801 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.157077 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.157330 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.157488 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.157707 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.157917 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.157917 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.158402 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.158574 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.158729 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.158883 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.159038 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.159192 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.159338 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.159338 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.160508 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.160673 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.160843 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.160998 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.161150 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.161305 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.161451 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.161610 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.161840 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.161991 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.162147 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.162301 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.162445 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.162608 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.162764 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.162908 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.163051 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.163206 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.163359 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.163517 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.163661 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.163804 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.163946 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.164096 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.164241 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.164397 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.164544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.164709 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.164862 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.165006 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.165159 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.165346 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.165509 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.166220 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.166384 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.166384 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.166686 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.166850 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.167102 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.167278 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.167439 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.167439 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.167733 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.167733 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.168025 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.168170 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.168326 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.168326 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.168629 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 10:07:42.168776 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.168920 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.168920 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.169201 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.169427 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.169575 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.169789 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.170439 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.170765 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.170923 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.171084 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.171238 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.171393 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.171547 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.171693 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.171847 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.172016 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.172162 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.172308 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.172452 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.172596 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.172739 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.172893 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.173046 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.173263 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.173467 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.173791 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.174019 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.174171 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.174328 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.174488 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.174741 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.174741 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.175258 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.175418 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.175564 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.175745 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.175902 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.176048 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.176201 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.176354 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.176500 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.176655 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.176830 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.176987 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.177145 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.177307 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.177461 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.177632 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.177797 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.177992 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.178146 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.178290 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.178442 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.178602 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.178755 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.178912 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.179066 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.179222 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.179368 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.179518 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.179663 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.179820 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.179976 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.180627 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.180966 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.181128 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.181294 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.181449 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.181594 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.181781 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.181935 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.182087 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.182248 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.182394 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.182538 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.182682 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.182825 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.182976 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.183131 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.183295 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.183448 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.183601 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.183746 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.183889 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.184043 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.184195 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.184350 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.184503 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.184649 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.184800 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.184957 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.185102 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.185262 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.185416 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.185561 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.185778 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.185933 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.186078 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.186230 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.186374 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.186527 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.186686 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.186840 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.186993 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.187146 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.187318 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.187465 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.187624 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.187770 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.187921 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.188072 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.188224 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.188368 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.188522 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.188674 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.188871 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.189093 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.189593 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.189993 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.190679 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.190839 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.191184 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.191332 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.191485 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.191652 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.191815 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.191975 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.192134 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.192285 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.192285 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.192602 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.192765 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.192917 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.193075 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.193225 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.193383 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.193543 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.193730 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.193894 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.194055 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.194213 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.194373 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.194524 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.194688 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.194848 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.195013 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.195164 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.195328 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.195489 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.195648 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.195806 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.195977 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.196129 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.196282 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.196440 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.196602 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.196762 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.196976 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.197139 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.197308 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.197460 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.197610 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.197833 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.197987 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.198145 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.198145 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.198439 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.198598 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.198769 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.198922 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.199075 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.199239 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.199400 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.199400 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.199700 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.199852 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.200002 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.200154 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.200795 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.200955 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.201307 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.201479 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.201649 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.201818 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.201970 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.202131 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.202284 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.202435 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.202594 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.202754 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.202907 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.203072 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.203225 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.203377 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.203546 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.203697 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.203853 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.204020 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.204172 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.204331 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.204565 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.204798 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.205059 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.205324 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.205532 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.205721 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.205897 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.205897 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.206199 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.206353 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.206504 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.206655 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.206805 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.206955 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.207123 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.207283 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.207447 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.207606 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.207758 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.207926 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.208093 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.208359 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.208519 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.208671 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.208823 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.208987 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.209139 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.209296 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.209455 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.209643 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.209804 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.209968 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.210132 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.210290 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.210933 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.211102 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.211255 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.211619 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.211781 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.211941 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.212102 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.212253 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.212413 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.212573 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.212733 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.212895 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.212895 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.213199 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.213360 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.213521 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.213703 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.213868 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.214027 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.214186 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.214365 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.214527 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.214679 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.214831 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.215005 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.215166 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.215328 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.215488 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.215639 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.215799 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.215951 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.216111 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.216310 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.216464 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.216622 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.216781 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.216953 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.217118 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.217287 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.217447 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.217607 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.217808 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.217960 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.218125 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.218285 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.218438 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.218589 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.218749 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.218900 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.219076 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.219236 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.219395 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.219546 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.219705 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.219857 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.220024 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.220269 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.221749 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.221933 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.222091 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.222255 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.222255 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.222568 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.222720 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.222880 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.223040 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.223209 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.223362 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.223523 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.223675 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.223827 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.223978 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.224139 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.224292 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.224451 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.224451 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.224757 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.224757 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.225139 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.225296 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.225447 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.225607 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.225837 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.226007 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.226163 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.226323 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.226474 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.226625 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.226795 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.226958 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.227125 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.227288 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.227441 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.227598 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.227765 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.227927 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.228087 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.228239 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.228399 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.228550 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.228712 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.228878 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.229031 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.229183 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.229347 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.229508 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.229678 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.229847 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.230000 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.230160 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.230319 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.230473 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.230638 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.230809 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.230969 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.231904 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.232080 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.232243 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.232411 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.232576 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.232730 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.232890 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.233049 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.233209 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.233440 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.233763 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.233950 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.234105 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.234105 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.234403 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.234565 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.234718 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.234870 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.235030 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.235189 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.235351 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.235511 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.235718 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.235915 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.236163 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.236402 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.236664 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.236928 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.237091 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.237253 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.237412 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.237564 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.237759 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.237915 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.238067 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.238225 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.238395 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.238548 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.238714 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.238868 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.239027 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.239186 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.239338 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.239499 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.239666 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.239819 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.239819 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.240124 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.240284 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.240460 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.240614 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.240766 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.240920 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.241081 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.241261 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.242198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.242362 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.242523 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.242683 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.242836 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.242998 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.243168 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.243335 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.243487 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.243487 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.243790 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.243790 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.246591 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.246591 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.246915 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.247115 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.247386 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.247560 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.247724 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.247888 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.248055 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.248219 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.248373 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.248526 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.248685 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.248838 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.248999 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.249152 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.249309 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.249470 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.249658 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.249817 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.249998 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.250152 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.250312 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.250473 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.250633 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.250786 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.251010 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.251177 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.251377 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.252569 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.252739 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.252894 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.253061 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.253226 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.253387 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.253549 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.253726 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.253894 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.254055 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.254207 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.254365 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.254526 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.254688 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.254857 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.255017 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.255171 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.255341 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.255501 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.255655 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.255816 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.255969 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.256121 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.256280 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.256434 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.256585 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.256758 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.256913 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.257072 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.257254 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.257417 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.257584 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.257775 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.257929 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.258080 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.258239 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.258401 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.258567 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.258721 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.258873 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.259025 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.259184 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.259352 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.259352 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.259659 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.259812 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.259971 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.260123 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.260281 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.260442 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.260594 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.260745 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.260898 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.261056 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.261221 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.261392 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.261544 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.262359 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.262778 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.262938 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.263112 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.263268 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.263428 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.263594 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.263748 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.263908 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.264071 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.264224 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.264404 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.264565 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.264724 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.264885 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.264885 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.265189 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.265189 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.265521 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.265691 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.265860 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.265860 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.266159 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.266320 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.266472 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.266623 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.266784 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.267018 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.267403 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.267667 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.267922 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.268134 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.268373 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.268529 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.268681 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.268853 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.269597 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.269801 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.269967 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.270132 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.270294 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.270456 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.270618 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.270788 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.270941 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.271093 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.271255 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.271409 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.271560 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.271732 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.271893 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.272496 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.272924 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.273089 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.273241 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.273411 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.273574 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.273801 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.273954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.274108 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.274273 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.274427 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.274592 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.274744 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.274905 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.275058 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.275297 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.275472 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.275641 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.275802 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.275962 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.276114 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.276284 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.276445 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.276610 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.276771 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.276924 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.277080 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.277245 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.277398 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.277557 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.277749 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.277915 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.278069 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.278235 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.278388 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.278532 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.278634 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.278761 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.278761 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.279080 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.279206 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.279357 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.279498 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.279587 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.279729 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.279845 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.279966 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.280090 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.280214 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.280329 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.280440 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.280552 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.280670 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.280791 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.280791 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.281022 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.281136 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.281247 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.281365 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.281486 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.281609 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.281748 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.281874 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.281997 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.282308 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.282775 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.283333 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.283551 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.283551 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.283834 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.283949 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.284062 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.284190 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.284313 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.284426 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.284540 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.284650 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.284773 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.284896 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.285012 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.285132 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.285247 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.285358 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.285480 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.285602 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.285741 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.285865 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.285990 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.285990 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.286226 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.286349 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.286469 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.286583 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.286694 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.286805 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.286932 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.287056 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.287191 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.287314 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.287436 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.287562 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.287684 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.287806 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.287919 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.288032 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.288152 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.288276 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.288391 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.288503 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.288614 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.288742 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.288857 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.288983 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.289097 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.289097 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.289325 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.289438 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.289655 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.289776 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.289898 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.290010 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.290135 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.290251 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.290379 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.290492 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.290605 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.290716 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.290832 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.290956 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.291071 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.291191 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.291315 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.291449 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.291581 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.291724 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.291863 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.292000 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.292137 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.292423 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.292825 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.292955 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.293172 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.293469 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.293592 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.293727 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.293842 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.293969 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.294093 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.294215 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.294336 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.294457 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.294585 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.294699 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.294820 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.294934 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.295046 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.295166 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.295290 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.295403 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.295516 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.295636 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.295757 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.295871 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.295993 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.296106 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.296226 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.296338 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.296450 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.296573 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.296687 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.296799 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.296935 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.297064 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.297181 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.297306 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.297430 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.297559 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.297765 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.297882 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.297993 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.298114 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.298364 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.298543 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.298708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.298856 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.298984 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.299112 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.299292 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.299420 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.299554 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.299668 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.299787 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.299913 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.300038 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.300164 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.300278 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.300388 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.300514 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.300636 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.300750 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.300860 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.300979 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.301110 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.301233 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.301346 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.301460 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.301590 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.301728 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.301855 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.301984 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.302106 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.302217 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.302345 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.302625 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.303009 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.303150 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.303347 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.303662 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.303783 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.303896 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.304023 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.304145 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.304266 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.304387 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.304508 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.304621 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.304747 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.304863 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.304975 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.305087 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.305198 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.305309 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.305431 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.305545 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.305545 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.305545 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.305545 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.306617 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.306734 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.306853 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.306975 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.307106 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.307233 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.307362 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.307476 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.307596 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.307710 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.307829 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.307945 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.308072 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.308203 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.308324 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.308437 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.308547 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.308678 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.308892 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.309011 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.309133 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.309254 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.309375 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.309503 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.309842 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.309980 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.310102 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.310216 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.310327 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.310453 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.310566 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.310678 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.310788 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.310788 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.310998 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.310998 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.311228 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.311342 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.311461 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.311582 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.311704 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.311894 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.312013 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.312132 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.312254 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.312377 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.312500 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.312777 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.313161 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.313291 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.313514 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.313885 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.314197 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.314400 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.314608 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.314741 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.314871 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.314995 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.315119 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.315233 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.315233 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.315451 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.315565 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.315676 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.315874 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.315989 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.316112 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.316233 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.316355 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.316478 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.316592 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.316712 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.316833 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.316954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.317073 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.317205 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.317329 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.317451 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.317573 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.317711 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.317850 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.317940 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.318023 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.318096 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.318168 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.318237 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.318309 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.318392 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.318465 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.318537 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.318616 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.318698 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.318784 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.318865 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.318938 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.319016 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.319096 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.319168 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.319255 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.319328 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.319407 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.319487 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.319568 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.319642 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.319721 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.319833 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.319923 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.320004 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.320078 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.320159 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.320240 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.320312 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.320384 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.320456 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.320456 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.320609 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.320684 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.320755 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.320825 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.320903 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.320983 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.320983 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.321132 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.321205 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.321285 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.321358 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.321438 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.321521 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.321595 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.322030 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.322156 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.322156 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.322394 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.322515 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.322635 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.322911 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.323286 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.323405 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.323546 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.323741 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.323971 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.324098 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.324322 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.324440 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.324567 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.324683 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.324794 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.324907 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.325017 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.325142 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.325264 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.325377 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.325504 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.325667 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.325790 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.325918 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.326043 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.326154 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.326273 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.326395 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.326518 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.326632 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.326743 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.326855 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.326981 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.327111 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.327241 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.327364 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.327477 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.327589 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.327701 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.327820 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.327946 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.328061 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.328180 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.328293 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.328413 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.328571 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.328697 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.328819 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.328939 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.329060 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.329179 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.329179 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.329433 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.329558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.329750 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.330003 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.330272 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.330515 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.330675 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.330844 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.330998 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.331160 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.331929 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.332090 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.332090 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.332409 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.332570 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.332731 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.333374 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.333597 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.334235 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.334531 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.334694 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.334856 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.335016 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.335177 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.335330 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.335500 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.335662 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.335824 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.335984 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.336151 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.336313 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.336468 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.336627 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.336781 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.336933 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.337093 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.337264 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.337426 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.337426 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.337756 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.337756 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.338048 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.338228 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.338383 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.338536 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.338699 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.338852 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.338852 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.339150 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.339303 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.339464 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.339617 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.339769 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.339931 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.340099 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.340258 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.340419 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.340572 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.340732 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.340966 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.341130 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.341889 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.342068 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.342224 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.342378 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.342546 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.342702 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.342875 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.343578 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.343744 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.343915 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.344187 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.344345 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.344516 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.344777 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.345087 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.346049 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.346202 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.346376 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.346534 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.346662 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.346753 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.346851 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.347113 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.347253 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.347397 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.347642 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.347784 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.347944 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.348075 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.348174 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.348271 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.348359 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.348455 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.348542 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.348626 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.348750 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.348884 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.348985 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.349087 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.349176 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.349261 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.349347 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.349440 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.349528 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.349645 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.349736 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.349736 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.349915 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.350005 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.350091 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.350196 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.350284 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.350378 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.350473 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.350561 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.350660 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.350660 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 04 10:07:42.350827 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.350827 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.350827 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.350827 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.350827 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.350827 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.350827 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.350827 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.351518 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.351518 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.351518 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.351518 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.351518 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.351518 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.351518 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.351518 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.352131 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.352131 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.352131 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.352131 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.352131 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.352131 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.352131 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.352131 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.352732 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.352732 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.352732 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.352732 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.352732 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.352732 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.352732 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.352732 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.353729 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.353729 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.353729 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.353729 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.353729 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.353729 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.353729 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.353729 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.354362 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.354362 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.354362 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.354362 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.354362 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.354362 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.354362 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.354362 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.354994 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.354994 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.354994 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.354994 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.354994 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.354994 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.354994 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.354994 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.355820 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.355820 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.355820 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.355820 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.355820 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.355820 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.355820 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.355820 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.356419 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.356419 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.356419 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.356419 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.356419 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.356419 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.356419 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.356419 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.357050 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.357050 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.357050 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.357050 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.357050 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.357050 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.357050 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.357050 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.357724 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.357724 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.357724 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.357724 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.357724 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.357724 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.357724 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.357724 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.358360 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.358360 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.358360 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.358360 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.358360 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.358360 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.358360 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.358360 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.358975 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.358975 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.358975 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.358975 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.358975 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.358975 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.358975 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.358975 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.359600 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.359600 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.359600 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.359850 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.360066 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.360382 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.360728 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.361046 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.361363 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.361701 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.362015 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.362322 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.362636 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.362945 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.363254 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.363573 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.363886 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.364209 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.364531 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.364838 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.365207 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.365482 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.365843 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.366157 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.366500 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.366828 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.367143 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.367465 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.367770 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 10:07:42.368012 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 04 10:07:42.389275 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO dbcounter [None req-eb22886e-39b4-490c-b6c2-6698a046518c None None] Registered counter for database nova_api Jul 04 10:07:42.409973 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_db.sqlalchemy.engines [None req-eb22886e-39b4-490c-b6c2-6698a046518c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117866) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 10:07:42.416827 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writer thread running {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 10:07:42.429650 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO dbcounter [None req-d7372f78-e0de-4cd4-a48b-c0829cea4360 None None] Registered counter for database nova_api Jul 04 10:07:42.450208 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_db.sqlalchemy.engines [None req-d7372f78-e0de-4cd4-a48b-c0829cea4360 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 10:07:42.458030 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writer thread running {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 10:07:42.473934 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.context [None req-eb22886e-39b4-490c-b6c2-6698a046518c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fcfe76a9-294c-4e42-99a5-517031194304(cell1) {{(pid=117866) load_cells /opt/stack/nova/nova/context.py:464}} Jul 04 10:07:42.478096 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-eb22886e-39b4-490c-b6c2-6698a046518c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:07:42.479686 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-eb22886e-39b4-490c-b6c2-6698a046518c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:07:42.480477 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-eb22886e-39b4-490c-b6c2-6698a046518c None None] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:07:42.482533 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-eb22886e-39b4-490c-b6c2-6698a046518c None None] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:07:42.484549 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO dbcounter [None req-eb22886e-39b4-490c-b6c2-6698a046518c None None] Registered counter for database nova_cell0 Jul 04 10:07:42.488863 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO dbcounter [None req-eb22886e-39b4-490c-b6c2-6698a046518c None None] Registered counter for database nova_cell1 Jul 04 10:07:42.496811 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_db.sqlalchemy.engines [None req-eb22886e-39b4-490c-b6c2-6698a046518c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117866) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 10:07:42.498577 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_db.sqlalchemy.engines [None req-eb22886e-39b4-490c-b6c2-6698a046518c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117866) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 10:07:42.504846 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writer thread running {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 10:07:42.506485 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writer thread running {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 10:07:42.514242 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.context [None req-d7372f78-e0de-4cd4-a48b-c0829cea4360 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fcfe76a9-294c-4e42-99a5-517031194304(cell1) {{(pid=117865) load_cells /opt/stack/nova/nova/context.py:464}} Jul 04 10:07:42.519112 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d7372f78-e0de-4cd4-a48b-c0829cea4360 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:07:42.520875 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d7372f78-e0de-4cd4-a48b-c0829cea4360 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:07:42.521690 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d7372f78-e0de-4cd4-a48b-c0829cea4360 None None] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:07:42.523651 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d7372f78-e0de-4cd4-a48b-c0829cea4360 None None] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:07:42.525698 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO dbcounter [None req-d7372f78-e0de-4cd4-a48b-c0829cea4360 None None] Registered counter for database nova_cell0 Jul 04 10:07:42.529738 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO dbcounter [None req-d7372f78-e0de-4cd4-a48b-c0829cea4360 None None] Registered counter for database nova_cell1 Jul 04 10:07:42.537148 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_db.sqlalchemy.engines [None req-d7372f78-e0de-4cd4-a48b-c0829cea4360 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 10:07:42.541143 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_db.sqlalchemy.engines [None req-d7372f78-e0de-4cd4-a48b-c0829cea4360 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 10:07:42.542996 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writer thread running {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 10:07:42.651620 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO dbcounter [None req-eb22886e-39b4-490c-b6c2-6698a046518c None None] Registered counter for database nova_cell0 Jul 04 10:07:42.658846 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_db.sqlalchemy.engines [None req-eb22886e-39b4-490c-b6c2-6698a046518c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117866) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 10:07:42.663746 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writer thread running {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 10:07:42.688604 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writer thread running {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 10:07:42.699581 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO dbcounter [None req-d7372f78-e0de-4cd4-a48b-c0829cea4360 None None] Registered counter for database nova_cell0 Jul 04 10:07:42.707047 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_db.sqlalchemy.engines [None req-d7372f78-e0de-4cd4-a48b-c0829cea4360 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 10:07:42.711756 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writer thread running {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 10:07:42.978671 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: WARNING keystonemiddleware.auth_token [None req-eb22886e-39b4-490c-b6c2-6698a046518c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 10:07:42.985987 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: WARNING keystonemiddleware.auth_token [None req-eb22886e-39b4-490c-b6c2-6698a046518c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 10:07:43.028808 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: WARNING keystonemiddleware.auth_token [None req-d7372f78-e0de-4cd4-a48b-c0829cea4360 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 10:07:43.036400 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: WARNING keystonemiddleware.auth_token [None req-d7372f78-e0de-4cd4-a48b-c0829cea4360 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 10:07:43.333240 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: WARNING keystonemiddleware.auth_token [None req-eb22886e-39b4-490c-b6c2-6698a046518c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 10:07:43.340376 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: WARNING keystonemiddleware.auth_token [None req-eb22886e-39b4-490c-b6c2-6698a046518c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 10:07:43.346585 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5646002849c0 pid: 117866 (default app) Jul 04 10:07:43.384728 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: WARNING keystonemiddleware.auth_token [None req-d7372f78-e0de-4cd4-a48b-c0829cea4360 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 10:07:43.390823 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: WARNING keystonemiddleware.auth_token [None req-d7372f78-e0de-4cd4-a48b-c0829cea4360 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 10:07:43.396263 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5646002849c0 pid: 117865 (default app) Jul 04 10:08:25.132036 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_api:SELECT=3 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:08:25.140356 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell1:SELECT=3 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:08:25.143793 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell0:SELECT=3 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:08:25.147162 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell0:SELECT=3 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:08:26.479296 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-9d19c4a6-9102-4876-a9c0-5518420644de tempest-VolumesNegativeTest-1006536886 tempest-VolumesNegativeTest-1006536886-project] Action: 'create', calling method: .version_select at 0x7f2809032700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-729242361", "metadata": {"Type": "work"}}} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:08:26.509683 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-9d19c4a6-9102-4876-a9c0-5518420644de tempest-VolumesNegativeTest-1006536886 tempest-VolumesNegativeTest-1006536886-project] Request method failure captured: Jul 04 10:08:26.509683 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 04 10:08:26.509683 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept: application/json Jul 04 10:08:26.509683 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept-Encoding: identity Jul 04 10:08:26.509683 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Connection: close Jul 04 10:08:26.509683 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Length: 121 Jul 04 10:08:26.509683 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Type: application/json Jul 04 10:08:26.509683 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Host: 10.222.0.79 Jul 04 10:08:26.509683 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Openstack-System-Scope: None Jul 04 10:08:26.509683 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: User-Agent: python-urllib3/1.26.9 Jul 04 10:08:26.509683 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Auth-Token: gAAAAABiwrwYvjHmuIVMlf_SbG6mOHRUImnEldNjT9vTm8WfGFhbBd7M6bSwv5GjQzipUqu9cyJ7OFcIPdfurB42Z_nHlFIRFxHdoQtIBYWClfgY34A9IjHYBHwshc-kKT0CaAqv79mQ4zN8YPZpf3XXR4xXpsNOKELU7jv27EHgV5-QRxtIBOg Jul 04 10:08:26.509683 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Id: None Jul 04 10:08:26.509683 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Name: None Jul 04 10:08:26.509683 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Identity-Status: Confirmed Jul 04 10:08:26.509683 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Is-Admin-Project: True Jul 04 10:08:26.509683 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Id: default Jul 04 10:08:26.509683 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Name: Default Jul 04 10:08:26.509683 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Id: c79e08ac71944d41853bc2ac057a288a Jul 04 10:08:26.509683 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Name: tempest-VolumesNegativeTest-1006536886 Jul 04 10:08:26.509683 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Role: reader,member Jul 04 10:08:26.509683 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Roles: reader,member Jul 04 10:08:26.511023 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c79e08ac71944d41853bc2ac057a288a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c79e08ac71944d41853bc2ac057a288a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c79e08ac71944d41853bc2ac057a288a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c79e08ac71944d41853bc2ac057a288a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:08:26.511023 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant: tempest-VolumesNegativeTest-1006536886 Jul 04 10:08:26.511023 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Id: c79e08ac71944d41853bc2ac057a288a Jul 04 10:08:26.511023 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Name: tempest-VolumesNegativeTest-1006536886 Jul 04 10:08:26.511023 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User: tempest-VolumesNegativeTest-1006536886-project Jul 04 10:08:26.511023 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Id: default Jul 04 10:08:26.511023 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Name: Default Jul 04 10:08:26.511023 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Id: 6301fe8744584190b1720c0e42299b91 Jul 04 10:08:26.511023 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Name: tempest-VolumesNegativeTest-1006536886-project Jul 04 10:08:26.511023 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Jul 04 10:08:26.511023 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-729242361", "metadata": {"Type": "work"}}} Jul 04 10:08:26.511023 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: method: Jul 04 10:08:26.511023 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 04 10:08:26.511997 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-729242361', 'metadata': {'Type': 'work'}}}} Jul 04 10:08:26.511997 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:08:26.511997 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:08:26.511997 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 04 10:08:26.511997 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 04 10:08:26.511997 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 04 10:08:26.511997 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise error Jul 04 10:08:26.511997 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 04 10:08:26.511997 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:08:26.511997 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 04 10:08:26.511997 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 04 10:08:26.511997 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:08:26.511997 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 04 10:08:26.511997 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi '#$%' Jul 04 10:08:26.511997 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:08:26.511997 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:08:26.511997 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:08:26.511997 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:08:26.511997 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:08:26.511997 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:08:26.511997 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:08:26.511997 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:08:26.514867 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 10:08:26.514867 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 10:08:26.514867 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:08:26.514867 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:08:26.514867 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 04 10:08:26.514867 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 04 10:08:26.514867 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 04 10:08:26.514867 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 04 10:08:26.514867 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 04 10:08:26.514867 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 04 10:08:26.514867 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 04 10:08:26.514867 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:08:26.514867 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:08:26.514867 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:08:26.514867 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:08:26.514867 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:08:26.514867 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:08:26.514867 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 04 10:08:26.514867 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 04 10:08:26.518685 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 04 10:08:26.518685 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:08:26.518685 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-9d19c4a6-9102-4876-a9c0-5518420644de tempest-VolumesNegativeTest-1006536886 tempest-VolumesNegativeTest-1006536886-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:08:26.518685 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-9d19c4a6-9102-4876-a9c0-5518420644de tempest-VolumesNegativeTest-1006536886 tempest-VolumesNegativeTest-1006536886-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.396461 Jul 04 10:08:26.518685 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 1/1] 10.222.0.79 () {60 vars in 1155 bytes} [Mon Jul 4 10:08:25 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1399 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 04 10:08:26.523525 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=3 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:08:26.524326 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=3 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:08:26.525716 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=3 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:08:26.526598 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=3 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:08:26.858049 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e31c8be7-2378-41f6-83bd-aa82474b973c tempest-VolumesNegativeTest-1006536886 tempest-VolumesNegativeTest-1006536886-project] Action: 'create', calling method: .version_select at 0x7f2809071310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-986394007", "metadata": {"Type": "work"}}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:08:26.862735 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e31c8be7-2378-41f6-83bd-aa82474b973c tempest-VolumesNegativeTest-1006536886 tempest-VolumesNegativeTest-1006536886-project] Request method failure captured: Jul 04 10:08:26.862735 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 04 10:08:26.862735 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept: application/json Jul 04 10:08:26.862735 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept-Encoding: identity Jul 04 10:08:26.862735 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Connection: close Jul 04 10:08:26.862735 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Length: 119 Jul 04 10:08:26.862735 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Type: application/json Jul 04 10:08:26.862735 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Host: 10.222.0.79 Jul 04 10:08:26.862735 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 04 10:08:26.862735 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 04 10:08:26.862735 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Auth-Token: gAAAAABiwrwYvjHmuIVMlf_SbG6mOHRUImnEldNjT9vTm8WfGFhbBd7M6bSwv5GjQzipUqu9cyJ7OFcIPdfurB42Z_nHlFIRFxHdoQtIBYWClfgY34A9IjHYBHwshc-kKT0CaAqv79mQ4zN8YPZpf3XXR4xXpsNOKELU7jv27EHgV5-QRxtIBOg Jul 04 10:08:26.862735 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Id: None Jul 04 10:08:26.862735 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Name: None Jul 04 10:08:26.862735 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 04 10:08:26.862735 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 04 10:08:26.862735 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 04 10:08:26.862735 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 04 10:08:26.862735 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Id: c79e08ac71944d41853bc2ac057a288a Jul 04 10:08:26.862735 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Name: tempest-VolumesNegativeTest-1006536886 Jul 04 10:08:26.862735 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Role: reader,member Jul 04 10:08:26.862735 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Roles: reader,member Jul 04 10:08:26.864529 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c79e08ac71944d41853bc2ac057a288a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c79e08ac71944d41853bc2ac057a288a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c79e08ac71944d41853bc2ac057a288a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c79e08ac71944d41853bc2ac057a288a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:08:26.864529 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant: tempest-VolumesNegativeTest-1006536886 Jul 04 10:08:26.864529 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Id: c79e08ac71944d41853bc2ac057a288a Jul 04 10:08:26.864529 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Name: tempest-VolumesNegativeTest-1006536886 Jul 04 10:08:26.864529 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User: tempest-VolumesNegativeTest-1006536886-project Jul 04 10:08:26.864529 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 04 10:08:26.864529 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 04 10:08:26.864529 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Id: 6301fe8744584190b1720c0e42299b91 Jul 04 10:08:26.864529 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Name: tempest-VolumesNegativeTest-1006536886-project Jul 04 10:08:26.864529 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Jul 04 10:08:26.864529 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-986394007", "metadata": {"Type": "work"}}} Jul 04 10:08:26.864529 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: method: Jul 04 10:08:26.864529 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 04 10:08:26.865544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-986394007', 'metadata': {'Type': 'work'}}}} Jul 04 10:08:26.865544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:08:26.865544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:08:26.865544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 04 10:08:26.865544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 04 10:08:26.865544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 04 10:08:26.865544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise error Jul 04 10:08:26.865544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 04 10:08:26.865544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:08:26.865544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 04 10:08:26.865544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 04 10:08:26.865544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:08:26.865544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 04 10:08:26.865544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi '0' Jul 04 10:08:26.865544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:08:26.865544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:08:26.865544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:08:26.865544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:08:26.865544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:08:26.865544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:08:26.865544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:08:26.865544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:08:26.868538 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 10:08:26.868538 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 10:08:26.868538 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:08:26.868538 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:08:26.868538 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 04 10:08:26.868538 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 04 10:08:26.868538 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 04 10:08:26.868538 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 04 10:08:26.868538 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 04 10:08:26.868538 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 04 10:08:26.868538 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 04 10:08:26.868538 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:08:26.868538 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:08:26.868538 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:08:26.868538 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:08:26.868538 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:08:26.868538 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:08:26.868538 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 04 10:08:26.868538 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 04 10:08:26.870199 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 04 10:08:26.870199 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:08:26.871904 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e31c8be7-2378-41f6-83bd-aa82474b973c tempest-VolumesNegativeTest-1006536886 tempest-VolumesNegativeTest-1006536886-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:08:26.873056 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-e31c8be7-2378-41f6-83bd-aa82474b973c tempest-VolumesNegativeTest-1006536886 tempest-VolumesNegativeTest-1006536886-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.354822 Jul 04 10:08:26.882000 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 1/2] 10.222.0.79 () {60 vars in 1155 bytes} [Mon Jul 4 10:08:26 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 365 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 04 10:08:26.883411 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-8a10544a-313e-4030-9965-703f34d2c868 tempest-VolumesNegativeTest-1006536886 tempest-VolumesNegativeTest-1006536886-project] Action: 'create', calling method: .version_select at 0x7f2808ffd9d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-944632666", "metadata": {"Type": "work"}}} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:08:26.886108 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-8a10544a-313e-4030-9965-703f34d2c868 tempest-VolumesNegativeTest-1006536886 tempest-VolumesNegativeTest-1006536886-project] Request method failure captured: Jul 04 10:08:26.886108 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 04 10:08:26.886108 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept: application/json Jul 04 10:08:26.886108 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept-Encoding: identity Jul 04 10:08:26.886108 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Connection: close Jul 04 10:08:26.886108 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Length: 118 Jul 04 10:08:26.886108 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Type: application/json Jul 04 10:08:26.886108 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Host: 10.222.0.79 Jul 04 10:08:26.886108 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Openstack-System-Scope: None Jul 04 10:08:26.886108 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: User-Agent: python-urllib3/1.26.9 Jul 04 10:08:26.886108 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Auth-Token: gAAAAABiwrwYvjHmuIVMlf_SbG6mOHRUImnEldNjT9vTm8WfGFhbBd7M6bSwv5GjQzipUqu9cyJ7OFcIPdfurB42Z_nHlFIRFxHdoQtIBYWClfgY34A9IjHYBHwshc-kKT0CaAqv79mQ4zN8YPZpf3XXR4xXpsNOKELU7jv27EHgV5-QRxtIBOg Jul 04 10:08:26.886108 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Id: None Jul 04 10:08:26.886108 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Name: None Jul 04 10:08:26.886108 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Identity-Status: Confirmed Jul 04 10:08:26.886108 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Is-Admin-Project: True Jul 04 10:08:26.886108 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Id: default Jul 04 10:08:26.886108 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Name: Default Jul 04 10:08:26.886108 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Id: c79e08ac71944d41853bc2ac057a288a Jul 04 10:08:26.886108 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Name: tempest-VolumesNegativeTest-1006536886 Jul 04 10:08:26.886108 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Role: reader,member Jul 04 10:08:26.886108 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Roles: reader,member Jul 04 10:08:26.887582 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c79e08ac71944d41853bc2ac057a288a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c79e08ac71944d41853bc2ac057a288a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c79e08ac71944d41853bc2ac057a288a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c79e08ac71944d41853bc2ac057a288a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:08:26.887582 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant: tempest-VolumesNegativeTest-1006536886 Jul 04 10:08:26.887582 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Id: c79e08ac71944d41853bc2ac057a288a Jul 04 10:08:26.887582 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Name: tempest-VolumesNegativeTest-1006536886 Jul 04 10:08:26.887582 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User: tempest-VolumesNegativeTest-1006536886-project Jul 04 10:08:26.887582 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Id: default Jul 04 10:08:26.887582 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Name: Default Jul 04 10:08:26.887582 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Id: 6301fe8744584190b1720c0e42299b91 Jul 04 10:08:26.887582 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Name: tempest-VolumesNegativeTest-1006536886-project Jul 04 10:08:26.887582 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Jul 04 10:08:26.887582 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-944632666", "metadata": {"Type": "work"}}} Jul 04 10:08:26.887582 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: method: Jul 04 10:08:26.887582 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 04 10:08:26.888567 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-944632666', 'metadata': {'Type': 'work'}}}} Jul 04 10:08:26.888567 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:08:26.888567 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:08:26.888567 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 04 10:08:26.888567 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 04 10:08:26.888567 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 04 10:08:26.888567 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise error Jul 04 10:08:26.888567 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 04 10:08:26.888567 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:08:26.888567 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 04 10:08:26.888567 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 04 10:08:26.888567 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:08:26.888567 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 04 10:08:26.888567 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi '' Jul 04 10:08:26.888567 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:08:26.888567 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:08:26.888567 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:08:26.888567 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:08:26.888567 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:08:26.888567 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:08:26.888567 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:08:26.888567 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:08:26.890149 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 10:08:26.890149 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 10:08:26.890149 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:08:26.890149 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:08:26.890149 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 04 10:08:26.890149 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 04 10:08:26.890149 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 04 10:08:26.890149 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 04 10:08:26.890149 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 04 10:08:26.890149 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 04 10:08:26.890149 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 04 10:08:26.890149 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:08:26.890149 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:08:26.890149 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:08:26.890149 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:08:26.890149 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:08:26.890149 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:08:26.890149 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 04 10:08:26.890149 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 04 10:08:26.891342 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 04 10:08:26.891342 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:08:26.891342 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-8a10544a-313e-4030-9965-703f34d2c868 tempest-VolumesNegativeTest-1006536886 tempest-VolumesNegativeTest-1006536886-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:08:26.894068 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-8a10544a-313e-4030-9965-703f34d2c868 tempest-VolumesNegativeTest-1006536886 tempest-VolumesNegativeTest-1006536886-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008085 Jul 04 10:08:26.898151 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 2/3] 10.222.0.79 () {60 vars in 1155 bytes} [Mon Jul 4 10:08:26 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 04 10:08:26.928974 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-320da7d1-1aae-40bb-82a2-0853e57db70b tempest-VolumesNegativeTest-1006536886 tempest-VolumesNegativeTest-1006536886-project] Calling method '.version_select at 0x7f28098d7af0>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:08:27.731898 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-320da7d1-1aae-40bb-82a2-0853e57db70b tempest-VolumesNegativeTest-1006536886 tempest-VolumesNegativeTest-1006536886-project] HTTP exception thrown: Volume tempest-invalid-45204242 could not be found. Jul 04 10:08:27.739179 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-320da7d1-1aae-40bb-82a2-0853e57db70b tempest-VolumesNegativeTest-1006536886 tempest-VolumesNegativeTest-1006536886-project] Request method failure captured: Jul 04 10:08:27.739179 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-45204242 HTTP/1.1 Jul 04 10:08:27.739179 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept: application/json Jul 04 10:08:27.739179 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept-Encoding: identity Jul 04 10:08:27.739179 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Connection: close Jul 04 10:08:27.739179 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Length: 0 Jul 04 10:08:27.739179 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Type: application/json Jul 04 10:08:27.739179 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Host: 10.222.0.79 Jul 04 10:08:27.739179 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 04 10:08:27.739179 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 04 10:08:27.739179 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Auth-Token: gAAAAABiwrwYvjHmuIVMlf_SbG6mOHRUImnEldNjT9vTm8WfGFhbBd7M6bSwv5GjQzipUqu9cyJ7OFcIPdfurB42Z_nHlFIRFxHdoQtIBYWClfgY34A9IjHYBHwshc-kKT0CaAqv79mQ4zN8YPZpf3XXR4xXpsNOKELU7jv27EHgV5-QRxtIBOg Jul 04 10:08:27.739179 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Id: None Jul 04 10:08:27.739179 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Name: None Jul 04 10:08:27.739179 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 04 10:08:27.739179 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 04 10:08:27.739179 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 04 10:08:27.739179 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 04 10:08:27.739179 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Id: c79e08ac71944d41853bc2ac057a288a Jul 04 10:08:27.739179 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Name: tempest-VolumesNegativeTest-1006536886 Jul 04 10:08:27.739179 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Role: reader,member Jul 04 10:08:27.739179 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Roles: reader,member Jul 04 10:08:27.740584 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c79e08ac71944d41853bc2ac057a288a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c79e08ac71944d41853bc2ac057a288a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c79e08ac71944d41853bc2ac057a288a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c79e08ac71944d41853bc2ac057a288a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:08:27.740584 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant: tempest-VolumesNegativeTest-1006536886 Jul 04 10:08:27.740584 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Id: c79e08ac71944d41853bc2ac057a288a Jul 04 10:08:27.740584 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Name: tempest-VolumesNegativeTest-1006536886 Jul 04 10:08:27.740584 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User: tempest-VolumesNegativeTest-1006536886-project Jul 04 10:08:27.740584 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 04 10:08:27.740584 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 04 10:08:27.740584 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Id: 6301fe8744584190b1720c0e42299b91 Jul 04 10:08:27.740584 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Name: tempest-VolumesNegativeTest-1006536886-project Jul 04 10:08:27.740584 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: method: Jul 04 10:08:27.740584 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: exception: Volume tempest-invalid-45204242 could not be found. Jul 04 10:08:27.740584 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: action_args: {'id': 'tempest-invalid-45204242'} Jul 04 10:08:27.740584 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:08:27.741392 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:08:27.741392 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 10:08:27.741392 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 10:08:27.741392 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 04 10:08:27.741392 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 04 10:08:27.741392 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 04 10:08:27.741392 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 04 10:08:27.741392 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 04 10:08:27.741392 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 04 10:08:27.741392 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 04 10:08:27.741392 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 04 10:08:27.741392 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 10:08:27.741392 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 10:08:27.741392 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 10:08:27.741392 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 10:08:27.741392 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-45204242 could not be found. (HTTP 404) (Request-ID: req-efab101b-675a-4143-822f-d6a1939b68d9) Jul 04 10:08:27.741392 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:08:27.741392 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:08:27.741392 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:08:27.742609 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:08:27.742609 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 04 10:08:27.742609 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 04 10:08:27.742609 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 10:08:27.742609 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 10:08:27.742609 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 10:08:27.742609 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 10:08:27.742609 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 10:08:27.742609 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 10:08:27.742609 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 10:08:27.742609 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 10:08:27.742609 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 04 10:08:27.742609 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 04 10:08:27.742609 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 04 10:08:27.742609 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 04 10:08:27.742609 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 04 10:08:27.742609 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 04 10:08:27.742609 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 04 10:08:27.742609 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 04 10:08:27.743829 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 10:08:27.743829 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 10:08:27.743829 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 10:08:27.743829 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 10:08:27.743829 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-45204242 could not be found. Jul 04 10:08:27.743829 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:08:27.743829 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:08:27.743829 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:08:27.743829 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:08:27.743829 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:08:27.743829 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:08:27.743829 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:08:27.743829 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:08:27.743829 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 10:08:27.743829 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 10:08:27.743829 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:08:27.743829 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:08:27.743829 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 04 10:08:27.743829 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:08:27.743829 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-45204242 could not be found. Jul 04 10:08:27.744979 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:08:27.744979 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:08:27.744979 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:08:27.744979 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:08:27.744979 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:08:27.744979 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:08:27.744979 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:08:27.744979 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:08:27.744979 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-45204242 could not be found. Jul 04 10:08:27.744979 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:08:27.747765 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-320da7d1-1aae-40bb-82a2-0853e57db70b tempest-VolumesNegativeTest-1006536886 tempest-VolumesNegativeTest-1006536886-project] Returning 404 to user: Volume tempest-invalid-45204242 could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:08:27.750056 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-320da7d1-1aae-40bb-82a2-0853e57db70b tempest-VolumesNegativeTest-1006536886 tempest-VolumesNegativeTest-1006536886-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/tempest-invalid-45204242" status: 404 len: 97 microversion: 2.1 time: 0.836500 Jul 04 10:08:27.754118 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 2/4] 10.222.0.79 () {58 vars in 1211 bytes} [Mon Jul 4 10:08:26 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-45204242 => generated 97 bytes in 843 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 04 10:08:27.765581 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-e732dca5-a111-4319-85b9-0472c3f9de74 tempest-VolumesNegativeTest-1006536886 tempest-VolumesNegativeTest-1006536886-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005816 Jul 04 10:08:27.767973 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 3/5] 10.222.0.79 () {58 vars in 1139 bytes} [Mon Jul 4 10:08:27 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 04 10:08:27.783604 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-58154e0e-fc20-4ab8-af68-992eb862cb60 tempest-VolumesNegativeTest-1006536886 tempest-VolumesNegativeTest-1006536886-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005062 Jul 04 10:08:27.785130 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 3/6] 10.222.0.79 () {58 vars in 1136 bytes} [Mon Jul 4 10:08:27 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 04 10:08:27.795901 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-a55ce931-6c70-4fea-9453-33a9031ae711 tempest-VolumesNegativeTest-1006536886 tempest-VolumesNegativeTest-1006536886-project] Calling method '.version_select at 0x7f2809032670>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:08:28.251843 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.wsgi [None req-a55ce931-6c70-4fea-9453-33a9031ae711 tempest-VolumesNegativeTest-1006536886 tempest-VolumesNegativeTest-1006536886-project] HTTP exception thrown: Volume 70db33ee-fa50-4522-8011-5d331ebdd09e could not be found. Jul 04 10:08:28.256722 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-a55ce931-6c70-4fea-9453-33a9031ae711 tempest-VolumesNegativeTest-1006536886 tempest-VolumesNegativeTest-1006536886-project] Request method failure captured: Jul 04 10:08:28.256722 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: request: DELETE /compute/v2.1/os-volumes/70db33ee-fa50-4522-8011-5d331ebdd09e HTTP/1.1 Jul 04 10:08:28.256722 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept: application/json Jul 04 10:08:28.256722 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept-Encoding: identity Jul 04 10:08:28.256722 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Connection: close Jul 04 10:08:28.256722 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Length: 0 Jul 04 10:08:28.256722 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Type: application/json Jul 04 10:08:28.256722 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Host: 10.222.0.79 Jul 04 10:08:28.256722 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Openstack-System-Scope: None Jul 04 10:08:28.256722 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: User-Agent: python-urllib3/1.26.9 Jul 04 10:08:28.256722 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Auth-Token: gAAAAABiwrwYvjHmuIVMlf_SbG6mOHRUImnEldNjT9vTm8WfGFhbBd7M6bSwv5GjQzipUqu9cyJ7OFcIPdfurB42Z_nHlFIRFxHdoQtIBYWClfgY34A9IjHYBHwshc-kKT0CaAqv79mQ4zN8YPZpf3XXR4xXpsNOKELU7jv27EHgV5-QRxtIBOg Jul 04 10:08:28.256722 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Id: None Jul 04 10:08:28.256722 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Name: None Jul 04 10:08:28.256722 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Identity-Status: Confirmed Jul 04 10:08:28.256722 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Is-Admin-Project: True Jul 04 10:08:28.256722 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Id: default Jul 04 10:08:28.256722 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Name: Default Jul 04 10:08:28.256722 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Id: c79e08ac71944d41853bc2ac057a288a Jul 04 10:08:28.256722 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Name: tempest-VolumesNegativeTest-1006536886 Jul 04 10:08:28.256722 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Role: reader,member Jul 04 10:08:28.256722 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Roles: reader,member Jul 04 10:08:28.258112 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c79e08ac71944d41853bc2ac057a288a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c79e08ac71944d41853bc2ac057a288a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c79e08ac71944d41853bc2ac057a288a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c79e08ac71944d41853bc2ac057a288a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:08:28.258112 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant: tempest-VolumesNegativeTest-1006536886 Jul 04 10:08:28.258112 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Id: c79e08ac71944d41853bc2ac057a288a Jul 04 10:08:28.258112 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Name: tempest-VolumesNegativeTest-1006536886 Jul 04 10:08:28.258112 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User: tempest-VolumesNegativeTest-1006536886-project Jul 04 10:08:28.258112 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Id: default Jul 04 10:08:28.258112 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Name: Default Jul 04 10:08:28.258112 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Id: 6301fe8744584190b1720c0e42299b91 Jul 04 10:08:28.258112 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Name: tempest-VolumesNegativeTest-1006536886-project Jul 04 10:08:28.258112 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: method: Jul 04 10:08:28.258112 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: exception: Volume 70db33ee-fa50-4522-8011-5d331ebdd09e could not be found. Jul 04 10:08:28.258112 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: action_args: {'id': '70db33ee-fa50-4522-8011-5d331ebdd09e'} Jul 04 10:08:28.258112 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:08:28.258903 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:08:28.258903 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 10:08:28.258903 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 10:08:28.258903 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 04 10:08:28.258903 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 04 10:08:28.258903 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 04 10:08:28.258903 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 04 10:08:28.258903 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 04 10:08:28.258903 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 04 10:08:28.258903 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 04 10:08:28.258903 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 04 10:08:28.258903 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 10:08:28.258903 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 10:08:28.258903 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 10:08:28.258903 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 10:08:28.258903 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 70db33ee-fa50-4522-8011-5d331ebdd09e could not be found. (HTTP 404) (Request-ID: req-f5ca61e5-f846-4392-9154-bb07919174fa) Jul 04 10:08:28.258903 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:08:28.258903 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:08:28.258903 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:08:28.260969 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:08:28.260969 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 04 10:08:28.260969 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 04 10:08:28.260969 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 10:08:28.260969 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 10:08:28.260969 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 10:08:28.260969 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 10:08:28.260969 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 10:08:28.260969 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 10:08:28.260969 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 10:08:28.260969 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 10:08:28.260969 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 04 10:08:28.260969 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 04 10:08:28.260969 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 04 10:08:28.260969 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 04 10:08:28.260969 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 04 10:08:28.260969 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 04 10:08:28.260969 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 04 10:08:28.260969 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 04 10:08:28.263940 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 10:08:28.263940 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 10:08:28.263940 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 10:08:28.263940 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 10:08:28.263940 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 70db33ee-fa50-4522-8011-5d331ebdd09e could not be found. Jul 04 10:08:28.263940 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:08:28.263940 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:08:28.263940 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:08:28.263940 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:08:28.263940 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:08:28.263940 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:08:28.263940 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:08:28.263940 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:08:28.263940 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 10:08:28.263940 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 10:08:28.263940 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:08:28.263940 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:08:28.263940 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 04 10:08:28.263940 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:08:28.267128 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 70db33ee-fa50-4522-8011-5d331ebdd09e could not be found. Jul 04 10:08:28.267128 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:08:28.267128 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:08:28.267128 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:08:28.267128 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:08:28.267128 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:08:28.267128 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:08:28.267128 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:08:28.267128 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:08:28.267128 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 70db33ee-fa50-4522-8011-5d331ebdd09e could not be found. Jul 04 10:08:28.267128 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:08:28.271198 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-a55ce931-6c70-4fea-9453-33a9031ae711 tempest-VolumesNegativeTest-1006536886 tempest-VolumesNegativeTest-1006536886-project] Returning 404 to user: Volume 70db33ee-fa50-4522-8011-5d331ebdd09e could not be found. {{(pid=117866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:08:28.273324 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-a55ce931-6c70-4fea-9453-33a9031ae711 tempest-VolumesNegativeTest-1006536886 tempest-VolumesNegativeTest-1006536886-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/70db33ee-fa50-4522-8011-5d331ebdd09e" status: 404 len: 109 microversion: 2.1 time: 0.480766 Jul 04 10:08:28.274545 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 4/7] 10.222.0.79 () {58 vars in 1247 bytes} [Mon Jul 4 10:08:27 2022] DELETE /compute/v2.1/os-volumes/70db33ee-fa50-4522-8011-5d331ebdd09e => generated 109 bytes in 483 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:08:28.284585 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-55fa53ab-f0f0-4506-8b3e-2126ccb381ff tempest-VolumesNegativeTest-1006536886 tempest-VolumesNegativeTest-1006536886-project] Calling method '.version_select at 0x7f2808e88280>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:08:28.340168 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-55fa53ab-f0f0-4506-8b3e-2126ccb381ff tempest-VolumesNegativeTest-1006536886 tempest-VolumesNegativeTest-1006536886-project] HTTP exception thrown: Volume b7ead306-36e9-4b78-a941-db7244fa2ac1 could not be found. Jul 04 10:08:28.342123 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-55fa53ab-f0f0-4506-8b3e-2126ccb381ff tempest-VolumesNegativeTest-1006536886 tempest-VolumesNegativeTest-1006536886-project] Request method failure captured: Jul 04 10:08:28.342123 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: request: GET /compute/v2.1/os-volumes/b7ead306-36e9-4b78-a941-db7244fa2ac1 HTTP/1.1 Jul 04 10:08:28.342123 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept: application/json Jul 04 10:08:28.342123 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept-Encoding: identity Jul 04 10:08:28.342123 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Connection: close Jul 04 10:08:28.342123 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Length: 0 Jul 04 10:08:28.342123 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Type: application/json Jul 04 10:08:28.342123 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Host: 10.222.0.79 Jul 04 10:08:28.342123 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 04 10:08:28.342123 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 04 10:08:28.342123 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Auth-Token: gAAAAABiwrwYvjHmuIVMlf_SbG6mOHRUImnEldNjT9vTm8WfGFhbBd7M6bSwv5GjQzipUqu9cyJ7OFcIPdfurB42Z_nHlFIRFxHdoQtIBYWClfgY34A9IjHYBHwshc-kKT0CaAqv79mQ4zN8YPZpf3XXR4xXpsNOKELU7jv27EHgV5-QRxtIBOg Jul 04 10:08:28.342123 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Id: None Jul 04 10:08:28.342123 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Name: None Jul 04 10:08:28.342123 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 04 10:08:28.342123 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 04 10:08:28.342123 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 04 10:08:28.342123 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 04 10:08:28.342123 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Id: c79e08ac71944d41853bc2ac057a288a Jul 04 10:08:28.342123 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Name: tempest-VolumesNegativeTest-1006536886 Jul 04 10:08:28.342123 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Role: reader,member Jul 04 10:08:28.342123 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Roles: reader,member Jul 04 10:08:28.343815 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c79e08ac71944d41853bc2ac057a288a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c79e08ac71944d41853bc2ac057a288a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c79e08ac71944d41853bc2ac057a288a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c79e08ac71944d41853bc2ac057a288a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:08:28.343815 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant: tempest-VolumesNegativeTest-1006536886 Jul 04 10:08:28.343815 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Id: c79e08ac71944d41853bc2ac057a288a Jul 04 10:08:28.343815 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Name: tempest-VolumesNegativeTest-1006536886 Jul 04 10:08:28.343815 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User: tempest-VolumesNegativeTest-1006536886-project Jul 04 10:08:28.343815 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 04 10:08:28.343815 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 04 10:08:28.343815 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Id: 6301fe8744584190b1720c0e42299b91 Jul 04 10:08:28.343815 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Name: tempest-VolumesNegativeTest-1006536886-project Jul 04 10:08:28.343815 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: method: Jul 04 10:08:28.343815 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: exception: Volume b7ead306-36e9-4b78-a941-db7244fa2ac1 could not be found. Jul 04 10:08:28.343815 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: action_args: {'id': 'b7ead306-36e9-4b78-a941-db7244fa2ac1'} Jul 04 10:08:28.343815 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:08:28.345592 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:08:28.345592 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 10:08:28.345592 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 10:08:28.345592 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 10:08:28.345592 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 10:08:28.345592 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 10:08:28.345592 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 10:08:28.345592 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 10:08:28.345592 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 10:08:28.345592 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 10:08:28.345592 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 10:08:28.345592 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 10:08:28.345592 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 10:08:28.345592 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 10:08:28.345592 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 10:08:28.345592 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b7ead306-36e9-4b78-a941-db7244fa2ac1 could not be found. (HTTP 404) (Request-ID: req-8c5b699e-93e6-46b8-8ba3-9ecaeb1bdc2a) Jul 04 10:08:28.345592 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:08:28.345592 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:08:28.345592 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:08:28.349689 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:08:28.349689 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 04 10:08:28.349689 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 04 10:08:28.349689 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 10:08:28.349689 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 10:08:28.349689 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 10:08:28.349689 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 10:08:28.349689 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 10:08:28.349689 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 10:08:28.349689 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 10:08:28.349689 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 10:08:28.349689 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 10:08:28.349689 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 10:08:28.349689 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 10:08:28.349689 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 10:08:28.349689 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 10:08:28.349689 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 10:08:28.349689 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 10:08:28.349689 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 10:08:28.353687 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 10:08:28.353687 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 10:08:28.353687 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 10:08:28.353687 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 10:08:28.353687 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b7ead306-36e9-4b78-a941-db7244fa2ac1 could not be found. Jul 04 10:08:28.353687 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:08:28.353687 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:08:28.353687 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:08:28.353687 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:08:28.353687 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:08:28.353687 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:08:28.353687 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:08:28.353687 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:08:28.353687 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 10:08:28.353687 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 10:08:28.353687 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:08:28.353687 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:08:28.353687 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 04 10:08:28.353687 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:08:28.356457 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b7ead306-36e9-4b78-a941-db7244fa2ac1 could not be found. Jul 04 10:08:28.356457 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:08:28.356457 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:08:28.356457 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:08:28.356457 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:08:28.356457 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:08:28.356457 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:08:28.356457 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:08:28.356457 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:08:28.356457 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b7ead306-36e9-4b78-a941-db7244fa2ac1 could not be found. Jul 04 10:08:28.356457 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:08:28.356457 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-55fa53ab-f0f0-4506-8b3e-2126ccb381ff tempest-VolumesNegativeTest-1006536886 tempest-VolumesNegativeTest-1006536886-project] Returning 404 to user: Volume b7ead306-36e9-4b78-a941-db7244fa2ac1 could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:08:28.356457 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-55fa53ab-f0f0-4506-8b3e-2126ccb381ff tempest-VolumesNegativeTest-1006536886 tempest-VolumesNegativeTest-1006536886-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/b7ead306-36e9-4b78-a941-db7244fa2ac1" status: 404 len: 109 microversion: 2.1 time: 0.063816 Jul 04 10:08:28.356457 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 4/8] 10.222.0.79 () {58 vars in 1244 bytes} [Mon Jul 4 10:08:28 2022] GET /compute/v2.1/os-volumes/b7ead306-36e9-4b78-a941-db7244fa2ac1 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:08:41.193352 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-1942c3ce-76ed-442e-b512-089730a954ad tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1397543009", "imageRef": "80bd29b0-b77c-4611-be31-69ca559a2d2a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:08:41.440430 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.network.neutron [None req-1942c3ce-76ed-442e-b512-089730a954ad tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] validate_networks() for [('ca42d015-9cb6-4405-9736-f11c22ec9001', None, None, None, None, None)] {{(pid=117866) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 10:08:42.092045 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-d024a394-4eb3-4141-9bc9-106edd665b28 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1240003596", "imageRef": "80bd29b0-b77c-4611-be31-69ca559a2d2a", "flavorRef": "452", "networks": [{"uuid": "66162d09-cc6b-4730-9f6b-77adf985caff"}]}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:08:42.340625 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.network.neutron [None req-d024a394-4eb3-4141-9bc9-106edd665b28 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] validate_networks() for [('66162d09-cc6b-4730-9f6b-77adf985caff', None, None, None, None, None)] {{(pid=117865) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 10:08:45.610594 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-1942c3ce-76ed-442e-b512-089730a954ad tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Flavor limits 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 10:08:45.611201 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-1942c3ce-76ed-442e-b512-089730a954ad tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Image limits 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 10:08:45.611470 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-1942c3ce-76ed-442e-b512-089730a954ad tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Flavor pref 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 10:08:45.612076 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-1942c3ce-76ed-442e-b512-089730a954ad tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Image pref 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 10:08:45.612533 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-1942c3ce-76ed-442e-b512-089730a954ad tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 10:08:45.639637 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1942c3ce-76ed-442e-b512-089730a954ad tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:08:45.640393 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1942c3ce-76ed-442e-b512-089730a954ad tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:08:45.641455 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1942c3ce-76ed-442e-b512-089730a954ad tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:08:45.642098 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1942c3ce-76ed-442e-b512-089730a954ad tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:08:45.644848 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-d024a394-4eb3-4141-9bc9-106edd665b28 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Flavor limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 10:08:45.645360 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-d024a394-4eb3-4141-9bc9-106edd665b28 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Image limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 10:08:45.646029 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-d024a394-4eb3-4141-9bc9-106edd665b28 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Flavor pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 10:08:45.646830 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-d024a394-4eb3-4141-9bc9-106edd665b28 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Image pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 10:08:45.647302 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-d024a394-4eb3-4141-9bc9-106edd665b28 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 10:08:45.673965 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d024a394-4eb3-4141-9bc9-106edd665b28 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:08:45.674530 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d024a394-4eb3-4141-9bc9-106edd665b28 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:08:45.675327 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d024a394-4eb3-4141-9bc9-106edd665b28 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:08:45.675754 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d024a394-4eb3-4141-9bc9-106edd665b28 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:08:45.744997 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.quota [None req-1942c3ce-76ed-442e-b512-089730a954ad tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Getting quotas for project 7f101e48ae9b4936a6d1b7bae000d7e1. Resources: {'cores', 'ram', 'instances'} {{(pid=117866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 10:08:45.760382 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.quota [None req-1942c3ce-76ed-442e-b512-089730a954ad tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Getting quotas for user fc9c26318d6c41f6b9455153f0d0e55b and project 7f101e48ae9b4936a6d1b7bae000d7e1. Resources: {'cores', 'ram', 'instances'} {{(pid=117866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 10:08:45.775105 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-1942c3ce-76ed-442e-b512-089730a954ad tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Going to run 1 instances... {{(pid=117866) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 10:08:45.778280 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-1942c3ce-76ed-442e-b512-089730a954ad tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80bd29b0-b77c-4611-be31-69ca559a2d2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 10:08:45.796472 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-d024a394-4eb3-4141-9bc9-106edd665b28 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Getting quotas for project c5f718c1e8ae45dbb633172c0ba74c5e. Resources: {'cores', 'ram', 'instances'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 10:08:45.805327 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-d024a394-4eb3-4141-9bc9-106edd665b28 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Getting quotas for user 64835c93d17543668a8039caeeaa393c and project c5f718c1e8ae45dbb633172c0ba74c5e. Resources: {'cores', 'ram', 'instances'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 10:08:45.825338 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d024a394-4eb3-4141-9bc9-106edd665b28 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Going to run 1 instances... {{(pid=117865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 10:08:45.829532 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d024a394-4eb3-4141-9bc9-106edd665b28 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] [instance: e8df803a-688f-4388-836b-8a16ccc26eba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80bd29b0-b77c-4611-be31-69ca559a2d2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 10:08:45.999676 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-1942c3ce-76ed-442e-b512-089730a954ad tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.093592 Jul 04 10:08:46.008683 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 5/9] 10.222.0.79 () {60 vars in 1146 bytes} [Mon Jul 4 10:08:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 5103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 10:08:46.050298 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-d024a394-4eb3-4141-9bc9-106edd665b28 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.495157 Jul 04 10:08:46.051030 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 5/10] 10.222.0.79 () {60 vars in 1146 bytes} [Mon Jul 4 10:08:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 4497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 10:08:46.589722 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-055af419-db36-4c6f-92b0-d56122620fc5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Action: 'create', calling method: .version_select at 0x7f2808d8e4c0>, body: {"keypair": {"name": "tempest-keypair-457655165", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJzjuEyeynPM4jC4Gx+FSEezX9MSScikQ+Sq+cXLzgR4q6oUgbY5lCK/MY55sYvKdEWtQwuOGcqXQxhViklsJxi6JdwhHWS2eByqIrrpz5tLMxqTkzBONJSnoA7G+D92w=="}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:08:46.668775 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-055af419-db36-4c6f-92b0-d56122620fc5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Getting quotas for project b852926ec18f4dc695da5ec1c5582f48. Resources: {'key_pairs'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 10:08:46.687650 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-055af419-db36-4c6f-92b0-d56122620fc5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Getting quotas for user 1c05b9b08df0437f9b0abb167d17aa56 and project b852926ec18f4dc695da5ec1c5582f48. Resources: {'key_pairs'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 10:08:46.745428 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-dbd2ee53-6eec-4269-aee9-2b60c3b6469b tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Action: 'create', calling method: .version_select at 0x7f2808d924c0>, body: {"keypair": {"name": "tempest-keypair-1594538124", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+4gy69hbuoMH3U+nZAwNRnVAHpWUjGgKq82hf2BbAe2BXNo/0jjey6d6rz+UK5lS83JgDzmngWXG0eCTnSEtaPBhWQMtmb35ge7nkAGqV4pbIaZtIH2ALaPHSzePf5bw=="}} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:08:46.770887 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-055af419-db36-4c6f-92b0-d56122620fc5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.718370 Jul 04 10:08:46.772030 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 6/11] 10.222.0.79 () {62 vars in 1199 bytes} [Mon Jul 4 10:08:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 720 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 04 10:08:46.777999 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8596a08e-a6c0-40c4-979c-2f46ce5b058b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:08:46.778568 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-8596a08e-a6c0-40c4-979c-2f46ce5b058b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:08:46.825894 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.quota [None req-dbd2ee53-6eec-4269-aee9-2b60c3b6469b tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Getting quotas for project 2f559cbed35f4fbb8fe71906696733e7. Resources: {'key_pairs'} {{(pid=117866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 10:08:46.839266 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.quota [None req-dbd2ee53-6eec-4269-aee9-2b60c3b6469b tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Getting quotas for user dfba262d439a4253bf1c2c0f114d0cdc and project 2f559cbed35f4fbb8fe71906696733e7. Resources: {'key_pairs'} {{(pid=117866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 10:08:46.939469 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-dbd2ee53-6eec-4269-aee9-2b60c3b6469b tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.929083 Jul 04 10:08:46.940843 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 6/12] 10.222.0.79 () {60 vars in 1158 bytes} [Mon Jul 4 10:08:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:08:46.946086 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-0a3a7896-438c-44f4-8528-dbb83a5aacd4 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:08:46.947002 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-0a3a7896-438c-44f4-8528-dbb83a5aacd4 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] [instance: e8df803a-688f-4388-836b-8a16ccc26eba] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:08:47.350738 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-8596a08e-a6c0-40c4-979c-2f46ce5b058b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:08:47.402344 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-8596a08e-a6c0-40c4-979c-2f46ce5b058b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120" status: 200 len: 1222 microversion: 2.1 time: 0.629356 Jul 04 10:08:47.402943 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 7/13] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:08:46 2022] GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120 => generated 1222 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:08:47.581903 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-914381a1-89d1-482b-89a9-a22a111f9aa6 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Action: 'create', calling method: .version_select at 0x7f2808d96c10>, body: {"keypair": {"name": "tempest-keypair-1525440355", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhEB3GGwcpgvVbGZBKve7XTQDMEyayFTuTZYgCHtA4WxHx7jRhsK2+Muiz2PAL5uEfi0S5K1Qn6YmNQtUk8diIJPbTWljobX9NBiYXLzI4LAEOeBzD6fSZYl7idgzbaLA=="}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:08:47.624191 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-914381a1-89d1-482b-89a9-a22a111f9aa6 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Getting quotas for project a57f93d66f534107a228d908afa64890. Resources: {'key_pairs'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 10:08:47.634760 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-914381a1-89d1-482b-89a9-a22a111f9aa6 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Getting quotas for user 88d2351fc3b74ef5a530fded1be6b997 and project a57f93d66f534107a228d908afa64890. Resources: {'key_pairs'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 10:08:47.707159 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-0a3a7896-438c-44f4-8528-dbb83a5aacd4 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64835c93d17543668a8039caeeaa393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f718c1e8ae45dbb633172c0ba74c5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:08:47.735472 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-914381a1-89d1-482b-89a9-a22a111f9aa6 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.267380 Jul 04 10:08:47.737424 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-0a3a7896-438c-44f4-8528-dbb83a5aacd4 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] 10.222.0.79 "GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba" status: 200 len: 1215 microversion: 2.1 time: 0.793892 Jul 04 10:08:47.745988 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 8/14] 10.222.0.79 () {60 vars in 1158 bytes} [Mon Jul 4 10:08:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 10:08:47.758923 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 7/15] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:08:46 2022] GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba => generated 1215 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:08:48.025275 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-aca9f050-8839-4ea4-bf57-1bbf821de006 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1401733749", "imageRef": "80bd29b0-b77c-4611-be31-69ca559a2d2a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:08:48.202888 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.network.neutron [None req-aca9f050-8839-4ea4-bf57-1bbf821de006 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] validate_networks() for [('ca42d015-9cb6-4405-9736-f11c22ec9001', None, None, None, None, None)] {{(pid=117865) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 10:08:48.771651 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-0270482d-9ea4-440c-835d-8f54a0b6b79b tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:08:48.772838 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-0270482d-9ea4-440c-835d-8f54a0b6b79b tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] [instance: e8df803a-688f-4388-836b-8a16ccc26eba] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:08:49.221887 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-0270482d-9ea4-440c-835d-8f54a0b6b79b tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64835c93d17543668a8039caeeaa393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f718c1e8ae45dbb633172c0ba74c5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:08:49.237939 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-0270482d-9ea4-440c-835d-8f54a0b6b79b tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] 10.222.0.79 "GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba" status: 200 len: 1215 microversion: 2.1 time: 0.468310 Jul 04 10:08:49.247442 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 8/16] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:08:48 2022] GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba => generated 1215 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:08:50.054547 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-aca9f050-8839-4ea4-bf57-1bbf821de006 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Flavor limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 10:08:50.055753 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-aca9f050-8839-4ea4-bf57-1bbf821de006 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Image limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 10:08:50.056466 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-aca9f050-8839-4ea4-bf57-1bbf821de006 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Flavor pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 10:08:50.057090 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-aca9f050-8839-4ea4-bf57-1bbf821de006 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Image pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 10:08:50.057801 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-aca9f050-8839-4ea4-bf57-1bbf821de006 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 10:08:50.071309 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aca9f050-8839-4ea4-bf57-1bbf821de006 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:08:50.072135 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aca9f050-8839-4ea4-bf57-1bbf821de006 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:08:50.073214 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aca9f050-8839-4ea4-bf57-1bbf821de006 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:08:50.073896 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aca9f050-8839-4ea4-bf57-1bbf821de006 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:08:50.169266 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-aca9f050-8839-4ea4-bf57-1bbf821de006 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Getting quotas for project 7f101e48ae9b4936a6d1b7bae000d7e1. Resources: {'cores', 'ram', 'instances'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 10:08:50.201313 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-aca9f050-8839-4ea4-bf57-1bbf821de006 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Getting quotas for user fc9c26318d6c41f6b9455153f0d0e55b and project 7f101e48ae9b4936a6d1b7bae000d7e1. Resources: {'cores', 'ram', 'instances'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 10:08:50.217644 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-aca9f050-8839-4ea4-bf57-1bbf821de006 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Going to run 1 instances... {{(pid=117865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 10:08:50.221269 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-aca9f050-8839-4ea4-bf57-1bbf821de006 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80bd29b0-b77c-4611-be31-69ca559a2d2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 10:08:50.255075 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-6ffb0848-4169-4e28-806a-5a36059efdf8 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:08:50.255696 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-6ffb0848-4169-4e28-806a-5a36059efdf8 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] [instance: e8df803a-688f-4388-836b-8a16ccc26eba] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:08:50.279027 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-6ffb0848-4169-4e28-806a-5a36059efdf8 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:08:50.279661 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-6ffb0848-4169-4e28-806a-5a36059efdf8 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:08:50.282461 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-6ffb0848-4169-4e28-806a-5a36059efdf8 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:08:50.282903 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-6ffb0848-4169-4e28-806a-5a36059efdf8 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:08:50.335520 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-aca9f050-8839-4ea4-bf57-1bbf821de006 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.317089 Jul 04 10:08:50.336718 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 9/17] 10.222.0.79 () {60 vars in 1146 bytes} [Mon Jul 4 10:08:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 2319 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 10:08:50.401653 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-7b9ecec3-3813-4c55-b468-b15afc82ba35 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:08:50.404942 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-7b9ecec3-3813-4c55-b468-b15afc82ba35 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:08:50.538309 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-7b9ecec3-3813-4c55-b468-b15afc82ba35 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:08:50.548374 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-7b9ecec3-3813-4c55-b468-b15afc82ba35 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1222 microversion: 2.1 time: 0.159532 Jul 04 10:08:50.549159 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 10/18] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:08:50 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1222 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:08:50.850149 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-6ffb0848-4169-4e28-806a-5a36059efdf8 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64835c93d17543668a8039caeeaa393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f718c1e8ae45dbb633172c0ba74c5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:08:50.883923 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-6ffb0848-4169-4e28-806a-5a36059efdf8 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] 10.222.0.79 "GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba" status: 200 len: 1267 microversion: 2.1 time: 0.631938 Jul 04 10:08:50.887255 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 9/19] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:08:50 2022] GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba => generated 1267 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:08:51.567473 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-ffbde839-f6dd-485d-9270-74086b38ed64 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:08:51.568828 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-ffbde839-f6dd-485d-9270-74086b38ed64 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:08:51.596204 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ffbde839-f6dd-485d-9270-74086b38ed64 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:08:51.603724 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ffbde839-f6dd-485d-9270-74086b38ed64 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:08:51.604688 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ffbde839-f6dd-485d-9270-74086b38ed64 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:08:51.605142 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ffbde839-f6dd-485d-9270-74086b38ed64 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:08:51.905339 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-7b67431b-517d-402b-8d60-c598a8d6627b tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:08:51.908403 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-7b67431b-517d-402b-8d60-c598a8d6627b tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] [instance: e8df803a-688f-4388-836b-8a16ccc26eba] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:08:51.932208 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7b67431b-517d-402b-8d60-c598a8d6627b tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:08:51.934480 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7b67431b-517d-402b-8d60-c598a8d6627b tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:08:51.935514 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7b67431b-517d-402b-8d60-c598a8d6627b tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:08:51.936451 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7b67431b-517d-402b-8d60-c598a8d6627b tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:08:52.995807 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-7b67431b-517d-402b-8d60-c598a8d6627b tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64835c93d17543668a8039caeeaa393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f718c1e8ae45dbb633172c0ba74c5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:08:53.010045 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-7b67431b-517d-402b-8d60-c598a8d6627b tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] 10.222.0.79 "GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba" status: 200 len: 1273 microversion: 2.1 time: 1.109515 Jul 04 10:08:53.012018 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 10/20] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:08:51 2022] GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba => generated 1273 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:08:53.058463 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-ffbde839-f6dd-485d-9270-74086b38ed64 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:08:53.084438 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-ffbde839-f6dd-485d-9270-74086b38ed64 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1226 microversion: 2.1 time: 1.522599 Jul 04 10:08:53.100966 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 11/21] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:08:51 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1226 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:08:54.030676 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-68873487-2060-4254-99b0-9ba4ec8496fb tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:08:54.031303 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-68873487-2060-4254-99b0-9ba4ec8496fb tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] [instance: e8df803a-688f-4388-836b-8a16ccc26eba] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:08:54.055543 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-68873487-2060-4254-99b0-9ba4ec8496fb tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:08:54.056036 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-68873487-2060-4254-99b0-9ba4ec8496fb tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:08:54.056832 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-68873487-2060-4254-99b0-9ba4ec8496fb tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:08:54.057271 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-68873487-2060-4254-99b0-9ba4ec8496fb tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:08:54.104375 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-16db3f0c-8ad2-4415-9839-3ab381167152 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:08:54.105758 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-16db3f0c-8ad2-4415-9839-3ab381167152 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:08:54.112473 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-16db3f0c-8ad2-4415-9839-3ab381167152 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:08:54.118697 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-16db3f0c-8ad2-4415-9839-3ab381167152 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:08:54.120696 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-16db3f0c-8ad2-4415-9839-3ab381167152 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:08:54.122028 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-16db3f0c-8ad2-4415-9839-3ab381167152 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:08:54.552021 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-16db3f0c-8ad2-4415-9839-3ab381167152 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:08:54.560797 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-16db3f0c-8ad2-4415-9839-3ab381167152 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1280 microversion: 2.1 time: 0.460399 Jul 04 10:08:54.574292 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 12/22] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:08:54 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1280 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:08:54.583152 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e2c2ddb6-f4c9-4ad5-a522-c5bf54976370 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-949760136", "imageRef": "80bd29b0-b77c-4611-be31-69ca559a2d2a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "28afbc1c-7fbf-4c17-a5be-8814771902ab"}], "security_groups": [{"name": "tempest-securitygroup--1097812010"}], "key_name": "tempest-keypair-1594538124", "user_data": "}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:08:55.227044 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-68873487-2060-4254-99b0-9ba4ec8496fb tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64835c93d17543668a8039caeeaa393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f718c1e8ae45dbb633172c0ba74c5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:08:55.235913 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-68873487-2060-4254-99b0-9ba4ec8496fb tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] 10.222.0.79 "GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba" status: 200 len: 1273 microversion: 2.1 time: 1.210138 Jul 04 10:08:55.236589 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 11/23] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:08:54 2022] GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba => generated 1273 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:08:55.599281 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-8049a2c4-3397-438f-ac99-5771941ff945 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:08:55.599901 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-8049a2c4-3397-438f-ac99-5771941ff945 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:08:55.616803 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8049a2c4-3397-438f-ac99-5771941ff945 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:08:55.617263 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8049a2c4-3397-438f-ac99-5771941ff945 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:08:55.618082 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8049a2c4-3397-438f-ac99-5771941ff945 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:08:55.618510 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8049a2c4-3397-438f-ac99-5771941ff945 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:08:55.700548 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.network.neutron [None req-e2c2ddb6-f4c9-4ad5-a522-c5bf54976370 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] validate_networks() for [('28afbc1c-7fbf-4c17-a5be-8814771902ab', None, None, None, None, None)] {{(pid=117865) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 10:08:55.702856 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell0:SELECT=2 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:08:55.937862 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-8049a2c4-3397-438f-ac99-5771941ff945 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:08:55.962095 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-8049a2c4-3397-438f-ac99-5771941ff945 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1280 microversion: 2.1 time: 0.373238 Jul 04 10:08:55.974059 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 12/24] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:08:55 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1280 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:08:56.262704 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-e24cca0c-b411-45e2-b9cb-51290bda48af tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:08:56.274087 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-e24cca0c-b411-45e2-b9cb-51290bda48af tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] [instance: e8df803a-688f-4388-836b-8a16ccc26eba] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:08:56.307972 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e24cca0c-b411-45e2-b9cb-51290bda48af tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:08:56.309787 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e24cca0c-b411-45e2-b9cb-51290bda48af tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:08:56.314909 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e24cca0c-b411-45e2-b9cb-51290bda48af tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:08:56.316865 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e24cca0c-b411-45e2-b9cb-51290bda48af tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:08:57.768484 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-e24cca0c-b411-45e2-b9cb-51290bda48af tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64835c93d17543668a8039caeeaa393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f718c1e8ae45dbb633172c0ba74c5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:08:57.803226 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-e24cca0c-b411-45e2-b9cb-51290bda48af tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] 10.222.0.79 "GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba" status: 200 len: 1315 microversion: 2.1 time: 1.552476 Jul 04 10:08:57.807789 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 13/25] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:08:56 2022] GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba => generated 1315 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:08:57.841459 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-0eb65941-8090-4832-9ec5-f716375dc0cc tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-900592905", "imageRef": "80bd29b0-b77c-4611-be31-69ca559a2d2a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3ebecf3d-37d9-4ade-a898-e313cec92aef"}], "security_groups": [{"name": "tempest-securitygroup--1392652173"}], "key_name": "tempest-keypair-1525440355", "user_data": "}} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:08:58.271712 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-e2c2ddb6-f4c9-4ad5-a522-c5bf54976370 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Flavor limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 10:08:58.272288 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-e2c2ddb6-f4c9-4ad5-a522-c5bf54976370 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Image limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 10:08:58.272931 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-e2c2ddb6-f4c9-4ad5-a522-c5bf54976370 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Flavor pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 10:08:58.273491 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-e2c2ddb6-f4c9-4ad5-a522-c5bf54976370 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Image pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 10:08:58.274071 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-e2c2ddb6-f4c9-4ad5-a522-c5bf54976370 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 10:08:58.299967 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e2c2ddb6-f4c9-4ad5-a522-c5bf54976370 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:08:58.300715 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e2c2ddb6-f4c9-4ad5-a522-c5bf54976370 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:08:58.301919 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e2c2ddb6-f4c9-4ad5-a522-c5bf54976370 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:08:58.305582 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e2c2ddb6-f4c9-4ad5-a522-c5bf54976370 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:08:58.385126 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-e2c2ddb6-f4c9-4ad5-a522-c5bf54976370 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Getting quotas for project 2f559cbed35f4fbb8fe71906696733e7. Resources: {'cores', 'ram', 'instances'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 10:08:58.404531 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-e2c2ddb6-f4c9-4ad5-a522-c5bf54976370 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Getting quotas for user dfba262d439a4253bf1c2c0f114d0cdc and project 2f559cbed35f4fbb8fe71906696733e7. Resources: {'cores', 'ram', 'instances'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 10:08:58.445724 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-e2c2ddb6-f4c9-4ad5-a522-c5bf54976370 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Going to run 1 instances... {{(pid=117865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 10:08:58.450666 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-e2c2ddb6-f4c9-4ad5-a522-c5bf54976370 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80bd29b0-b77c-4611-be31-69ca559a2d2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 10:08:58.575522 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-e2c2ddb6-f4c9-4ad5-a522-c5bf54976370 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.996562 Jul 04 10:08:58.584825 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 13/26] 10.222.0.79 () {60 vars in 1146 bytes} [Mon Jul 4 10:08:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 4006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 10:08:58.592074 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-048db8ad-0fe9-477a-9d1f-1025c469aa94 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:08:58.593848 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-048db8ad-0fe9-477a-9d1f-1025c469aa94 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:08:58.602923 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-048db8ad-0fe9-477a-9d1f-1025c469aa94 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:08:58.603566 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-048db8ad-0fe9-477a-9d1f-1025c469aa94 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:08:58.604579 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-048db8ad-0fe9-477a-9d1f-1025c469aa94 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:08:58.605194 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-048db8ad-0fe9-477a-9d1f-1025c469aa94 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:08:58.688119 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.network.neutron [None req-0eb65941-8090-4832-9ec5-f716375dc0cc tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] validate_networks() for [('3ebecf3d-37d9-4ade-a898-e313cec92aef', None, None, None, None, None)] {{(pid=117866) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 10:08:59.233856 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell0:SELECT=14 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:00.041499 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-048db8ad-0fe9-477a-9d1f-1025c469aa94 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:00.053260 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-048db8ad-0fe9-477a-9d1f-1025c469aa94 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1322 microversion: 2.1 time: 1.466723 Jul 04 10:09:00.054192 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 14/27] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:08:58 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1322 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:00.091319 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-c1c43a7f-2e47-4e03-b98a-2a5fcf35c440 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:00.102449 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-c1c43a7f-2e47-4e03-b98a-2a5fcf35c440 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:00.123829 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c1c43a7f-2e47-4e03-b98a-2a5fcf35c440 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:00.134900 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c1c43a7f-2e47-4e03-b98a-2a5fcf35c440 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:00.135866 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c1c43a7f-2e47-4e03-b98a-2a5fcf35c440 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:00.136343 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c1c43a7f-2e47-4e03-b98a-2a5fcf35c440 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:00.966372 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-c1c43a7f-2e47-4e03-b98a-2a5fcf35c440 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:00.982969 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-c1c43a7f-2e47-4e03-b98a-2a5fcf35c440 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1233 microversion: 2.1 time: 0.909157 Jul 04 10:09:00.995879 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 15/28] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:00 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1233 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:01.015992 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-cc85a538-61d8-4869-9a0f-79f857cfe0ec tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:01.018361 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-cc85a538-61d8-4869-9a0f-79f857cfe0ec tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] [instance: e8df803a-688f-4388-836b-8a16ccc26eba] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:01.047030 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cc85a538-61d8-4869-9a0f-79f857cfe0ec tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:01.048444 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cc85a538-61d8-4869-9a0f-79f857cfe0ec tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:01.051857 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cc85a538-61d8-4869-9a0f-79f857cfe0ec tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:01.056652 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cc85a538-61d8-4869-9a0f-79f857cfe0ec tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:02.600986 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-cc85a538-61d8-4869-9a0f-79f857cfe0ec tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64835c93d17543668a8039caeeaa393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f718c1e8ae45dbb633172c0ba74c5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:02.618124 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-cc85a538-61d8-4869-9a0f-79f857cfe0ec tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] 10.222.0.79 "GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba" status: 200 len: 1315 microversion: 2.1 time: 1.618372 Jul 04 10:09:02.622856 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 16/29] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:00 2022] GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba => generated 1315 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:02.650426 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-209dabe1-d371-4a2b-85de-d6c574d53ee5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1573423185", "imageRef": "80bd29b0-b77c-4611-be31-69ca559a2d2a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2931c1fd-bb14-4bfb-ad76-5fa1ab8e6e1a"}], "security_groups": [{"name": "tempest-securitygroup--1305378596"}], "key_name": "tempest-keypair-457655165", "user_data": "}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:09:02.870937 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-0eb65941-8090-4832-9ec5-f716375dc0cc tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Flavor limits 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 10:09:02.872662 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-0eb65941-8090-4832-9ec5-f716375dc0cc tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Image limits 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 10:09:02.874106 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-0eb65941-8090-4832-9ec5-f716375dc0cc tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Flavor pref 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 10:09:02.876490 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-0eb65941-8090-4832-9ec5-f716375dc0cc tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Image pref 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 10:09:02.877178 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-0eb65941-8090-4832-9ec5-f716375dc0cc tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 10:09:02.902383 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0eb65941-8090-4832-9ec5-f716375dc0cc tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:02.913265 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0eb65941-8090-4832-9ec5-f716375dc0cc tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:02.925716 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0eb65941-8090-4832-9ec5-f716375dc0cc tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:02.928934 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0eb65941-8090-4832-9ec5-f716375dc0cc tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:02.990084 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.quota [None req-0eb65941-8090-4832-9ec5-f716375dc0cc tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Getting quotas for project a57f93d66f534107a228d908afa64890. Resources: {'cores', 'ram', 'instances'} {{(pid=117866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 10:09:03.011800 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.quota [None req-0eb65941-8090-4832-9ec5-f716375dc0cc tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Getting quotas for user 88d2351fc3b74ef5a530fded1be6b997 and project a57f93d66f534107a228d908afa64890. Resources: {'cores', 'ram', 'instances'} {{(pid=117866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 10:09:03.045351 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-0eb65941-8090-4832-9ec5-f716375dc0cc tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Going to run 1 instances... {{(pid=117866) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 10:09:03.052218 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-0eb65941-8090-4832-9ec5-f716375dc0cc tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80bd29b0-b77c-4611-be31-69ca559a2d2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 10:09:03.217064 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-0eb65941-8090-4832-9ec5-f716375dc0cc tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.406937 Jul 04 10:09:03.217764 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 14/30] 10.222.0.79 () {60 vars in 1146 bytes} [Mon Jul 4 10:08:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 5409 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 10:09:03.243843 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-d963e1c5-0037-4991-9700-b79f05bc2622 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:03.245068 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-d963e1c5-0037-4991-9700-b79f05bc2622 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:03.271862 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d963e1c5-0037-4991-9700-b79f05bc2622 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:03.273571 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d963e1c5-0037-4991-9700-b79f05bc2622 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:03.274669 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d963e1c5-0037-4991-9700-b79f05bc2622 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:03.276259 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d963e1c5-0037-4991-9700-b79f05bc2622 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:03.300532 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.network.neutron [None req-209dabe1-d371-4a2b-85de-d6c574d53ee5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] validate_networks() for [('2931c1fd-bb14-4bfb-ad76-5fa1ab8e6e1a', None, None, None, None, None)] {{(pid=117865) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 10:09:03.962703 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-d963e1c5-0037-4991-9700-b79f05bc2622 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:03.973077 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-d963e1c5-0037-4991-9700-b79f05bc2622 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1322 microversion: 2.1 time: 0.752362 Jul 04 10:09:03.982414 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 15/31] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:03 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1322 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:03.988090 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-da3efc12-76bf-4ea6-80c4-149a7d47c5a0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:03.991605 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-da3efc12-76bf-4ea6-80c4-149a7d47c5a0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:04.004621 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-da3efc12-76bf-4ea6-80c4-149a7d47c5a0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:04.010371 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-da3efc12-76bf-4ea6-80c4-149a7d47c5a0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:04.011527 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-da3efc12-76bf-4ea6-80c4-149a7d47c5a0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:04.012170 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-da3efc12-76bf-4ea6-80c4-149a7d47c5a0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:04.231562 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-da3efc12-76bf-4ea6-80c4-149a7d47c5a0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:04.241405 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-da3efc12-76bf-4ea6-80c4-149a7d47c5a0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1295 microversion: 2.1 time: 0.257549 Jul 04 10:09:04.262975 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 16/32] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:03 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1295 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:04.836604 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-bfe81a46-9da5-42e3-956f-cfbc85c5b267 req-85a3eef5-1fde-43e2-a8ab-0370336c4c4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89a2c77a-967c-4273-a92c-1dbd36cda2dd", "tag": "f62e5e86-0d6c-4e20-bd83-d59470ae870f"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:09:04.875420 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-bfe81a46-9da5-42e3-956f-cfbc85c5b267 req-85a3eef5-1fde-43e2-a8ab-0370336c4c4f service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:04.887829 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-bfe81a46-9da5-42e3-956f-cfbc85c5b267 req-85a3eef5-1fde-43e2-a8ab-0370336c4c4f service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:04.964414 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-bfe81a46-9da5-42e3-956f-cfbc85c5b267 req-85a3eef5-1fde-43e2-a8ab-0370336c4c4f service nova] Creating event network-changed:f62e5e86-0d6c-4e20-bd83-d59470ae870f for instance 89a2c77a-967c-4273-a92c-1dbd36cda2dd on hv-cinder-84841 Jul 04 10:09:04.965031 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-bfe81a46-9da5-42e3-956f-cfbc85c5b267 req-85a3eef5-1fde-43e2-a8ab-0370336c4c4f service nova] Acquired lock "compute-rpcapi-router" {{(pid=117866) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 04 10:09:04.981647 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d99fc728-c116-41a7-9cae-2d8df0b03998 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:04.983067 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d99fc728-c116-41a7-9cae-2d8df0b03998 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:04.984493 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d99fc728-c116-41a7-9cae-2d8df0b03998 None None] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:04.985539 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d99fc728-c116-41a7-9cae-2d8df0b03998 None None] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:05.034650 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.compute.rpcapi [None req-d99fc728-c116-41a7-9cae-2d8df0b03998 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 04 10:09:05.035735 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d99fc728-c116-41a7-9cae-2d8df0b03998 None None] Releasing lock "compute-rpcapi-router" {{(pid=117866) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 04 10:09:05.078330 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-d99fc728-c116-41a7-9cae-2d8df0b03998 None None] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.812514 Jul 04 10:09:05.081531 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 17/33] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:09:05.093261 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-dc17d56e-c529-4195-8865-bd9614f8bc79 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:05.094357 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-dc17d56e-c529-4195-8865-bd9614f8bc79 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:05.115246 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-dc17d56e-c529-4195-8865-bd9614f8bc79 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:05.116190 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-dc17d56e-c529-4195-8865-bd9614f8bc79 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:05.120132 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-dc17d56e-c529-4195-8865-bd9614f8bc79 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:05.121471 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-dc17d56e-c529-4195-8865-bd9614f8bc79 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:05.527521 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-dc17d56e-c529-4195-8865-bd9614f8bc79 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:05.580102 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-dc17d56e-c529-4195-8865-bd9614f8bc79 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d" status: 200 len: 1293 microversion: 2.1 time: 0.495810 Jul 04 10:09:05.599784 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 18/34] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:05 2022] GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d => generated 1293 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:05.628449 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-3769ec83-32c7-4885-88fd-2a8bd03e0b92 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:05.637707 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-3769ec83-32c7-4885-88fd-2a8bd03e0b92 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] [instance: e8df803a-688f-4388-836b-8a16ccc26eba] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:05.668554 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3769ec83-32c7-4885-88fd-2a8bd03e0b92 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:05.670013 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3769ec83-32c7-4885-88fd-2a8bd03e0b92 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:05.672082 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3769ec83-32c7-4885-88fd-2a8bd03e0b92 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:05.675880 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3769ec83-32c7-4885-88fd-2a8bd03e0b92 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:05.778044 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-209dabe1-d371-4a2b-85de-d6c574d53ee5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Flavor limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 10:09:05.779793 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-209dabe1-d371-4a2b-85de-d6c574d53ee5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Image limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 10:09:05.787812 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-209dabe1-d371-4a2b-85de-d6c574d53ee5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Flavor pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 10:09:05.788417 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-209dabe1-d371-4a2b-85de-d6c574d53ee5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Image pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 10:09:05.789177 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-209dabe1-d371-4a2b-85de-d6c574d53ee5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 10:09:05.822736 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-209dabe1-d371-4a2b-85de-d6c574d53ee5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:05.823680 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-209dabe1-d371-4a2b-85de-d6c574d53ee5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:05.824870 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-209dabe1-d371-4a2b-85de-d6c574d53ee5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:05.825486 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-209dabe1-d371-4a2b-85de-d6c574d53ee5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:05.859768 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:05.877517 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-209dabe1-d371-4a2b-85de-d6c574d53ee5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Getting quotas for project b852926ec18f4dc695da5ec1c5582f48. Resources: {'cores', 'ram', 'instances'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 10:09:05.894049 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-209dabe1-d371-4a2b-85de-d6c574d53ee5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Getting quotas for user 1c05b9b08df0437f9b0abb167d17aa56 and project b852926ec18f4dc695da5ec1c5582f48. Resources: {'cores', 'ram', 'instances'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 10:09:05.933131 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-209dabe1-d371-4a2b-85de-d6c574d53ee5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Going to run 1 instances... {{(pid=117865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 10:09:05.944351 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-209dabe1-d371-4a2b-85de-d6c574d53ee5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80bd29b0-b77c-4611-be31-69ca559a2d2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 10:09:06.087860 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-209dabe1-d371-4a2b-85de-d6c574d53ee5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.460494 Jul 04 10:09:06.088555 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 17/35] 10.222.0.79 () {62 vars in 1187 bytes} [Mon Jul 4 10:09:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 3465 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 04 10:09:06.112054 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-d4e0b4da-e456-47f9-a7af-35340e197d96 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:06.113089 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d4e0b4da-e456-47f9-a7af-35340e197d96 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:06.170008 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d4e0b4da-e456-47f9-a7af-35340e197d96 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:06.170840 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d4e0b4da-e456-47f9-a7af-35340e197d96 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:06.171804 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d4e0b4da-e456-47f9-a7af-35340e197d96 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:06.172874 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d4e0b4da-e456-47f9-a7af-35340e197d96 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:07.496054 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-3769ec83-32c7-4885-88fd-2a8bd03e0b92 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64835c93d17543668a8039caeeaa393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f718c1e8ae45dbb633172c0ba74c5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:07.506065 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-3769ec83-32c7-4885-88fd-2a8bd03e0b92 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] 10.222.0.79 "GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba" status: 200 len: 1315 microversion: 2.1 time: 1.904877 Jul 04 10:09:07.509006 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 19/36] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:05 2022] GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba => generated 1315 bytes in 1909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:07.539401 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-2705eefc-dd20-4848-beef-dacfddabb036 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:07.540865 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-2705eefc-dd20-4848-beef-dacfddabb036 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:07.563633 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2705eefc-dd20-4848-beef-dacfddabb036 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:07.565060 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2705eefc-dd20-4848-beef-dacfddabb036 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:07.566329 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2705eefc-dd20-4848-beef-dacfddabb036 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:07.567944 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2705eefc-dd20-4848-beef-dacfddabb036 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:07.753131 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-d4e0b4da-e456-47f9-a7af-35340e197d96 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:07.772260 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-d4e0b4da-e456-47f9-a7af-35340e197d96 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1322 microversion: 2.1 time: 1.665076 Jul 04 10:09:07.772860 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 18/37] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:06 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1322 bytes in 1666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:07.777467 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-ce79df46-c2a8-45f1-bde8-f00e028b5b9d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:07.778158 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-ce79df46-c2a8-45f1-bde8-f00e028b5b9d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:07.804833 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ce79df46-c2a8-45f1-bde8-f00e028b5b9d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:07.805277 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ce79df46-c2a8-45f1-bde8-f00e028b5b9d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:07.809041 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ce79df46-c2a8-45f1-bde8-f00e028b5b9d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:07.809431 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ce79df46-c2a8-45f1-bde8-f00e028b5b9d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:07.969302 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-ce79df46-c2a8-45f1-bde8-f00e028b5b9d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:07.982284 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-ce79df46-c2a8-45f1-bde8-f00e028b5b9d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:07.984524 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-ce79df46-c2a8-45f1-bde8-f00e028b5b9d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:07.986380 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-ce79df46-c2a8-45f1-bde8-f00e028b5b9d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1333 microversion: 2.20 time: 0.212385 Jul 04 10:09:07.987557 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 19/38] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:09:07 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1333 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:09:08.048293 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-2705eefc-dd20-4848-beef-dacfddabb036 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:08.057023 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-2705eefc-dd20-4848-beef-dacfddabb036 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1363 microversion: 2.1 time: 0.545816 Jul 04 10:09:08.058821 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 20/39] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:07 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1363 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:08.078882 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-8f12aee9-18b2-4e55-b960-46641f317472 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:08.079878 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-8f12aee9-18b2-4e55-b960-46641f317472 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:08.087891 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8f12aee9-18b2-4e55-b960-46641f317472 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:08.088493 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8f12aee9-18b2-4e55-b960-46641f317472 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:08.089266 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8f12aee9-18b2-4e55-b960-46641f317472 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:08.089862 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8f12aee9-18b2-4e55-b960-46641f317472 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:08.174640 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-8f12aee9-18b2-4e55-b960-46641f317472 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:08.182644 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-8f12aee9-18b2-4e55-b960-46641f317472 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d" status: 200 len: 1299 microversion: 2.1 time: 0.122530 Jul 04 10:09:08.183166 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 21/40] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:08 2022] GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d => generated 1299 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:08.223661 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-d5f75e78-7999-4bef-a3e3-6464de2467c1 req-5d7610e0-17a1-4bf2-be54-efe3db8ee6d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a842f878-2275-4988-8e51-b3b7276678e7", "tag": "2172e408-c0ad-454d-89dc-0a5bd85b15cb"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:09:08.234150 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-d5f75e78-7999-4bef-a3e3-6464de2467c1 req-5d7610e0-17a1-4bf2-be54-efe3db8ee6d4 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:08.234863 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-d5f75e78-7999-4bef-a3e3-6464de2467c1 req-5d7610e0-17a1-4bf2-be54-efe3db8ee6d4 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:08.251250 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-d5f75e78-7999-4bef-a3e3-6464de2467c1 req-5d7610e0-17a1-4bf2-be54-efe3db8ee6d4 service nova] Creating event network-changed:2172e408-c0ad-454d-89dc-0a5bd85b15cb for instance a842f878-2275-4988-8e51-b3b7276678e7 on hv-cinder-84841 Jul 04 10:09:08.256505 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-d5f75e78-7999-4bef-a3e3-6464de2467c1 req-5d7610e0-17a1-4bf2-be54-efe3db8ee6d4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038699 Jul 04 10:09:08.257724 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 22/41] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 10:09:08.302329 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-b23f1991-b408-4836-b9df-0551441e9f8b req-7da984e0-e791-4dd2-a75e-f44613ad602f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8df803a-688f-4388-836b-8a16ccc26eba", "tag": "a30a62d5-35f1-42ed-b4ce-dbf70419be13"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:09:08.313792 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-b23f1991-b408-4836-b9df-0551441e9f8b req-7da984e0-e791-4dd2-a75e-f44613ad602f service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:08.314554 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-b23f1991-b408-4836-b9df-0551441e9f8b req-7da984e0-e791-4dd2-a75e-f44613ad602f service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:08.335914 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-b23f1991-b408-4836-b9df-0551441e9f8b req-7da984e0-e791-4dd2-a75e-f44613ad602f service nova] Creating event network-changed:a30a62d5-35f1-42ed-b4ce-dbf70419be13 for instance e8df803a-688f-4388-836b-8a16ccc26eba on hv-cinder-84841 Jul 04 10:09:08.336285 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-b23f1991-b408-4836-b9df-0551441e9f8b req-7da984e0-e791-4dd2-a75e-f44613ad602f service nova] Acquired lock "compute-rpcapi-router" {{(pid=117865) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 04 10:09:08.337567 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-91bc8ef1-c251-4e2b-ac98-002a14aa43bc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:08.338370 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-91bc8ef1-c251-4e2b-ac98-002a14aa43bc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:08.339309 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-91bc8ef1-c251-4e2b-ac98-002a14aa43bc None None] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:08.339743 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-91bc8ef1-c251-4e2b-ac98-002a14aa43bc None None] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:08.351516 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.compute.rpcapi [None req-91bc8ef1-c251-4e2b-ac98-002a14aa43bc None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 04 10:09:08.352773 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-91bc8ef1-c251-4e2b-ac98-002a14aa43bc None None] Releasing lock "compute-rpcapi-router" {{(pid=117865) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 04 10:09:08.372452 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-91bc8ef1-c251-4e2b-ac98-002a14aa43bc None None] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.383034 Jul 04 10:09:08.373241 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 20/42] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:09:08.526492 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-e6c99df8-fb3c-46b6-ae10-867f2aeb4630 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:08.527791 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-e6c99df8-fb3c-46b6-ae10-867f2aeb4630 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] [instance: e8df803a-688f-4388-836b-8a16ccc26eba] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:08.534242 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e6c99df8-fb3c-46b6-ae10-867f2aeb4630 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:08.534690 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e6c99df8-fb3c-46b6-ae10-867f2aeb4630 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:08.535463 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e6c99df8-fb3c-46b6-ae10-867f2aeb4630 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:08.535895 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e6c99df8-fb3c-46b6-ae10-867f2aeb4630 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:08.797483 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-99f8d376-9852-4e52-b748-43349dec5a3d tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:08.801021 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-99f8d376-9852-4e52-b748-43349dec5a3d tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:08.818566 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-99f8d376-9852-4e52-b748-43349dec5a3d tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:08.822170 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-99f8d376-9852-4e52-b748-43349dec5a3d tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:08.823588 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-99f8d376-9852-4e52-b748-43349dec5a3d tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:08.824797 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-99f8d376-9852-4e52-b748-43349dec5a3d tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:08.871589 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-e6c99df8-fb3c-46b6-ae10-867f2aeb4630 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64835c93d17543668a8039caeeaa393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f718c1e8ae45dbb633172c0ba74c5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:08.879697 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-e6c99df8-fb3c-46b6-ae10-867f2aeb4630 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] 10.222.0.79 "GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba" status: 200 len: 1315 microversion: 2.1 time: 0.357389 Jul 04 10:09:08.884896 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 23/43] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:08 2022] GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:09.005441 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-ad844eca-5f86-48e5-9351-8778ee36a2fe tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:09.006175 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-ad844eca-5f86-48e5-9351-8778ee36a2fe tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:09.021197 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ad844eca-5f86-48e5-9351-8778ee36a2fe tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:09.022097 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ad844eca-5f86-48e5-9351-8778ee36a2fe tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:09.023065 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ad844eca-5f86-48e5-9351-8778ee36a2fe tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:09.023495 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ad844eca-5f86-48e5-9351-8778ee36a2fe tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:09.268692 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-ad844eca-5f86-48e5-9351-8778ee36a2fe tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:09.284980 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-ad844eca-5f86-48e5-9351-8778ee36a2fe tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:09.286515 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-ad844eca-5f86-48e5-9351-8778ee36a2fe tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:09.287840 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-ad844eca-5f86-48e5-9351-8778ee36a2fe tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1341 microversion: 2.20 time: 0.287114 Jul 04 10:09:09.288542 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 24/44] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:09:08 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1341 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:09:09.294851 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-67575b3f-c5a9-4d0a-85c8-3fcf99672eaf tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:09.295620 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-67575b3f-c5a9-4d0a-85c8-3fcf99672eaf tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:09.310775 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-67575b3f-c5a9-4d0a-85c8-3fcf99672eaf tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:09.311673 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-67575b3f-c5a9-4d0a-85c8-3fcf99672eaf tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:09.313208 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-67575b3f-c5a9-4d0a-85c8-3fcf99672eaf tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:09.313861 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-67575b3f-c5a9-4d0a-85c8-3fcf99672eaf tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:09.497392 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-99f8d376-9852-4e52-b748-43349dec5a3d tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:09.505024 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-99f8d376-9852-4e52-b748-43349dec5a3d tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1322 microversion: 2.1 time: 0.718072 Jul 04 10:09:09.505610 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 21/45] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:08 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1322 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:09.518834 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-4b6c17d9-6318-4131-93f3-7dad446ce09f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:09.519684 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-4b6c17d9-6318-4131-93f3-7dad446ce09f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:09.526031 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4b6c17d9-6318-4131-93f3-7dad446ce09f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:09.526485 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4b6c17d9-6318-4131-93f3-7dad446ce09f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:09.527247 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4b6c17d9-6318-4131-93f3-7dad446ce09f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:09.527675 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4b6c17d9-6318-4131-93f3-7dad446ce09f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:09.653003 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-4b6c17d9-6318-4131-93f3-7dad446ce09f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:09.660854 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-4b6c17d9-6318-4131-93f3-7dad446ce09f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d" status: 200 len: 1299 microversion: 2.1 time: 0.145731 Jul 04 10:09:09.661825 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 22/46] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:09 2022] GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d => generated 1299 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:09.763065 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-67575b3f-c5a9-4d0a-85c8-3fcf99672eaf tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:09.771777 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-67575b3f-c5a9-4d0a-85c8-3fcf99672eaf tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1363 microversion: 2.1 time: 0.481967 Jul 04 10:09:09.772682 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 25/47] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:09 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1363 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:09.899544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-724c4d4d-0d69-4643-8dd5-89b5e4cef1c7 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:09.901096 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-724c4d4d-0d69-4643-8dd5-89b5e4cef1c7 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] [instance: e8df803a-688f-4388-836b-8a16ccc26eba] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:09.907788 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-724c4d4d-0d69-4643-8dd5-89b5e4cef1c7 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:09.908631 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-724c4d4d-0d69-4643-8dd5-89b5e4cef1c7 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:09.909914 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-724c4d4d-0d69-4643-8dd5-89b5e4cef1c7 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:09.910570 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-724c4d4d-0d69-4643-8dd5-89b5e4cef1c7 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:10.096184 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-724c4d4d-0d69-4643-8dd5-89b5e4cef1c7 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64835c93d17543668a8039caeeaa393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f718c1e8ae45dbb633172c0ba74c5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:10.103842 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-724c4d4d-0d69-4643-8dd5-89b5e4cef1c7 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] 10.222.0.79 "GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba" status: 200 len: 1315 microversion: 2.1 time: 0.208182 Jul 04 10:09:10.104626 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 23/48] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:09 2022] GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:10.307378 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-dc5354f0-a350-4ce7-8bf4-5e3a08ab23f4 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:10.309816 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-dc5354f0-a350-4ce7-8bf4-5e3a08ab23f4 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:10.317272 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-dc5354f0-a350-4ce7-8bf4-5e3a08ab23f4 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:10.317741 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-dc5354f0-a350-4ce7-8bf4-5e3a08ab23f4 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:10.318513 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-dc5354f0-a350-4ce7-8bf4-5e3a08ab23f4 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:10.318943 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-dc5354f0-a350-4ce7-8bf4-5e3a08ab23f4 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:10.394911 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-652216bb-d171-4182-b026-d4d500d0ec89 req-57875f91-62ac-452e-b2fd-204e98101015 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "068a560b-f200-4046-a36b-7ef23cea5120", "tag": "037993de-7a0b-470c-95e5-54eeb6c77200"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:09:10.395094 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-dc5354f0-a350-4ce7-8bf4-5e3a08ab23f4 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:10.398751 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell1:SELECT=100 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:10.403408 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-652216bb-d171-4182-b026-d4d500d0ec89 req-57875f91-62ac-452e-b2fd-204e98101015 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:10.403850 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-dc5354f0-a350-4ce7-8bf4-5e3a08ab23f4 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:10.403952 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-652216bb-d171-4182-b026-d4d500d0ec89 req-57875f91-62ac-452e-b2fd-204e98101015 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:10.405292 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-dc5354f0-a350-4ce7-8bf4-5e3a08ab23f4 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:10.406772 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-dc5354f0-a350-4ce7-8bf4-5e3a08ab23f4 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1339 microversion: 2.20 time: 0.103235 Jul 04 10:09:10.407524 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 26/49] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:09:10 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1339 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:09:10.427058 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-652216bb-d171-4182-b026-d4d500d0ec89 req-57875f91-62ac-452e-b2fd-204e98101015 service nova] Creating event network-changed:037993de-7a0b-470c-95e5-54eeb6c77200 for instance 068a560b-f200-4046-a36b-7ef23cea5120 on hv-cinder-84841 Jul 04 10:09:10.432166 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-652216bb-d171-4182-b026-d4d500d0ec89 req-57875f91-62ac-452e-b2fd-204e98101015 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040978 Jul 04 10:09:10.432754 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 24/50] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:09:10.522349 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-271aa96a-163e-40e5-bd2a-7615541cda04 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:10.522973 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-271aa96a-163e-40e5-bd2a-7615541cda04 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:10.529279 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-271aa96a-163e-40e5-bd2a-7615541cda04 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:10.529740 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-271aa96a-163e-40e5-bd2a-7615541cda04 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:10.530475 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-271aa96a-163e-40e5-bd2a-7615541cda04 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:10.530898 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-271aa96a-163e-40e5-bd2a-7615541cda04 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:10.669051 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-271aa96a-163e-40e5-bd2a-7615541cda04 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:10.678578 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-7afb40ea-8bc8-4af3-8a52-e7440c107794 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:10.678847 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-271aa96a-163e-40e5-bd2a-7615541cda04 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1322 microversion: 2.1 time: 0.160858 Jul 04 10:09:10.679416 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 27/51] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:10 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:10.679533 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-7afb40ea-8bc8-4af3-8a52-e7440c107794 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:10.686409 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7afb40ea-8bc8-4af3-8a52-e7440c107794 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:10.686934 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7afb40ea-8bc8-4af3-8a52-e7440c107794 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:10.687611 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7afb40ea-8bc8-4af3-8a52-e7440c107794 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:10.688073 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7afb40ea-8bc8-4af3-8a52-e7440c107794 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:10.789169 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-d87d2ed6-1315-4410-aa84-de23f38bd70a tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:10.790562 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-d87d2ed6-1315-4410-aa84-de23f38bd70a tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:10.796808 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d87d2ed6-1315-4410-aa84-de23f38bd70a tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:10.797250 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d87d2ed6-1315-4410-aa84-de23f38bd70a tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:10.798387 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d87d2ed6-1315-4410-aa84-de23f38bd70a tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:10.798590 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d87d2ed6-1315-4410-aa84-de23f38bd70a tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:10.827201 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-7afb40ea-8bc8-4af3-8a52-e7440c107794 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:10.834667 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-7afb40ea-8bc8-4af3-8a52-e7440c107794 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d" status: 200 len: 1367 microversion: 2.1 time: 0.160835 Jul 04 10:09:10.835236 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 25/52] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:10 2022] GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:09:11.119491 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-d87d2ed6-1315-4410-aa84-de23f38bd70a tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:11.126502 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-d1abcd13-0e83-47a7-82f9-8b4d1dbcd8e8 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:11.127104 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d1abcd13-0e83-47a7-82f9-8b4d1dbcd8e8 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] [instance: e8df803a-688f-4388-836b-8a16ccc26eba] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:11.134785 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d1abcd13-0e83-47a7-82f9-8b4d1dbcd8e8 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:11.135451 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d1abcd13-0e83-47a7-82f9-8b4d1dbcd8e8 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:11.136289 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-d87d2ed6-1315-4410-aa84-de23f38bd70a tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1363 microversion: 2.1 time: 0.351047 Jul 04 10:09:11.136628 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d1abcd13-0e83-47a7-82f9-8b4d1dbcd8e8 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:11.137335 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d1abcd13-0e83-47a7-82f9-8b4d1dbcd8e8 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:11.137447 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 28/53] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:10 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1363 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:11.281844 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-d1abcd13-0e83-47a7-82f9-8b4d1dbcd8e8 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64835c93d17543668a8039caeeaa393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f718c1e8ae45dbb633172c0ba74c5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:11.288448 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-d1abcd13-0e83-47a7-82f9-8b4d1dbcd8e8 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] 10.222.0.79 "GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba" status: 200 len: 1315 microversion: 2.1 time: 0.165623 Jul 04 10:09:11.289416 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 26/54] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:11 2022] GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:11.425203 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-b5d67509-8ba7-43d3-8506-c429744d0893 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:11.426082 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-b5d67509-8ba7-43d3-8506-c429744d0893 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:11.427963 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:11.433412 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b5d67509-8ba7-43d3-8506-c429744d0893 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:11.433888 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b5d67509-8ba7-43d3-8506-c429744d0893 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:11.434731 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b5d67509-8ba7-43d3-8506-c429744d0893 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:11.435161 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b5d67509-8ba7-43d3-8506-c429744d0893 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:11.498321 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-b5d67509-8ba7-43d3-8506-c429744d0893 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:11.506693 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-b5d67509-8ba7-43d3-8506-c429744d0893 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:11.508199 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-b5d67509-8ba7-43d3-8506-c429744d0893 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:11.509306 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-b5d67509-8ba7-43d3-8506-c429744d0893 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1339 microversion: 2.20 time: 0.088469 Jul 04 10:09:11.510043 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 29/55] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:09:11 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1339 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:09:11.695764 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-45f297c6-15c5-44cd-b85e-205fc2e9a481 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:11.696373 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-45f297c6-15c5-44cd-b85e-205fc2e9a481 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:11.702806 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-45f297c6-15c5-44cd-b85e-205fc2e9a481 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:11.703280 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-45f297c6-15c5-44cd-b85e-205fc2e9a481 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:11.704005 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-45f297c6-15c5-44cd-b85e-205fc2e9a481 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:11.704485 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-45f297c6-15c5-44cd-b85e-205fc2e9a481 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:11.707224 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=87 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:11.853289 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-ee5a4f84-f6a3-4ce8-8737-c74203f45e8d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:11.854667 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-ee5a4f84-f6a3-4ce8-8737-c74203f45e8d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:11.863993 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ee5a4f84-f6a3-4ce8-8737-c74203f45e8d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:11.864756 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ee5a4f84-f6a3-4ce8-8737-c74203f45e8d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:11.865740 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ee5a4f84-f6a3-4ce8-8737-c74203f45e8d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:11.866602 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ee5a4f84-f6a3-4ce8-8737-c74203f45e8d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:11.904920 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-45f297c6-15c5-44cd-b85e-205fc2e9a481 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:11.914010 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-45f297c6-15c5-44cd-b85e-205fc2e9a481 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1322 microversion: 2.1 time: 0.221991 Jul 04 10:09:11.914770 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 27/56] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:11 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:12.143338 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-ee5a4f84-f6a3-4ce8-8737-c74203f45e8d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:12.152645 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-ee5a4f84-f6a3-4ce8-8737-c74203f45e8d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d" status: 200 len: 1367 microversion: 2.1 time: 0.303812 Jul 04 10:09:12.154699 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-aad64cae-ad26-4b2b-bd60-3ef2c629db44 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:12.155889 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-aad64cae-ad26-4b2b-bd60-3ef2c629db44 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:12.160221 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 30/57] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:11 2022] GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d => generated 1367 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:12.168650 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aad64cae-ad26-4b2b-bd60-3ef2c629db44 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:12.169122 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aad64cae-ad26-4b2b-bd60-3ef2c629db44 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:12.177849 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aad64cae-ad26-4b2b-bd60-3ef2c629db44 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:12.178327 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aad64cae-ad26-4b2b-bd60-3ef2c629db44 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:12.306333 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-7fb5804e-e884-472c-9555-7fd0b97269c4 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:12.307134 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-7fb5804e-e884-472c-9555-7fd0b97269c4 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] [instance: e8df803a-688f-4388-836b-8a16ccc26eba] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:12.317508 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7fb5804e-e884-472c-9555-7fd0b97269c4 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:12.318418 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7fb5804e-e884-472c-9555-7fd0b97269c4 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:12.319455 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7fb5804e-e884-472c-9555-7fd0b97269c4 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:12.320566 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7fb5804e-e884-472c-9555-7fd0b97269c4 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:12.939066 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-aad64cae-ad26-4b2b-bd60-3ef2c629db44 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:12.942723 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-7fb5804e-e884-472c-9555-7fd0b97269c4 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64835c93d17543668a8039caeeaa393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f718c1e8ae45dbb633172c0ba74c5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:12.949173 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-aad64cae-ad26-4b2b-bd60-3ef2c629db44 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1363 microversion: 2.1 time: 0.798705 Jul 04 10:09:12.950458 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 28/58] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:12 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1363 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:12.957445 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-51c35445-9880-45b0-acba-6d88dc9e75dd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:12.958277 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-51c35445-9880-45b0-acba-6d88dc9e75dd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:12.961285 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-7fb5804e-e884-472c-9555-7fd0b97269c4 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] 10.222.0.79 "GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba" status: 200 len: 1315 microversion: 2.1 time: 0.659856 Jul 04 10:09:12.964735 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-51c35445-9880-45b0-acba-6d88dc9e75dd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:12.965474 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-51c35445-9880-45b0-acba-6d88dc9e75dd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:12.966873 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-51c35445-9880-45b0-acba-6d88dc9e75dd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:12.967467 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-51c35445-9880-45b0-acba-6d88dc9e75dd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:12.971718 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 31/59] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:12 2022] GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba => generated 1315 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:12.977171 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-82cbe661-d810-4283-bf28-b8e3ce850960 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:12.977994 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-82cbe661-d810-4283-bf28-b8e3ce850960 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:12.985472 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-82cbe661-d810-4283-bf28-b8e3ce850960 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:12.986500 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-82cbe661-d810-4283-bf28-b8e3ce850960 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:12.987436 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-82cbe661-d810-4283-bf28-b8e3ce850960 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:12.988170 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-82cbe661-d810-4283-bf28-b8e3ce850960 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:13.034386 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell0:SELECT=6 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:13.176428 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-51c35445-9880-45b0-acba-6d88dc9e75dd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:13.189182 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-51c35445-9880-45b0-acba-6d88dc9e75dd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:13.194054 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-51c35445-9880-45b0-acba-6d88dc9e75dd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:13.195947 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-51c35445-9880-45b0-acba-6d88dc9e75dd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1339 microversion: 2.20 time: 0.244499 Jul 04 10:09:13.199625 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 29/60] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:09:12 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1339 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:09:13.216920 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-558f3c19-d813-410e-966f-d816ed13f087 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:13.218014 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-558f3c19-d813-410e-966f-d816ed13f087 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:13.233133 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-558f3c19-d813-410e-966f-d816ed13f087 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:13.233987 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-558f3c19-d813-410e-966f-d816ed13f087 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:13.235426 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-558f3c19-d813-410e-966f-d816ed13f087 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:13.236015 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-558f3c19-d813-410e-966f-d816ed13f087 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:13.405443 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-82cbe661-d810-4283-bf28-b8e3ce850960 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:13.420221 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-82cbe661-d810-4283-bf28-b8e3ce850960 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1322 microversion: 2.1 time: 0.447223 Jul 04 10:09:13.433262 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 32/61] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:12 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1322 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:13.582938 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-558f3c19-d813-410e-966f-d816ed13f087 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:13.622568 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-558f3c19-d813-410e-966f-d816ed13f087 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d" status: 200 len: 1367 microversion: 2.1 time: 0.409958 Jul 04 10:09:13.627777 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 30/62] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:13 2022] GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d => generated 1367 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:13.966300 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-eb2649dd-f0a3-4883-ab35-bdb3e8c6853b tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:13.966922 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-eb2649dd-f0a3-4883-ab35-bdb3e8c6853b tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:13.975969 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-eb2649dd-f0a3-4883-ab35-bdb3e8c6853b tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:13.976729 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-eb2649dd-f0a3-4883-ab35-bdb3e8c6853b tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:13.977446 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-d153ae5e-8a6c-4e3f-b660-2712b86b9f01 req-c45efedc-d23c-42de-8e19-778424367b81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9659bd27-cdfe-44b1-9ffe-bec5319c9b5d", "tag": "5a1d4ccd-d32e-4fbf-9325-25b20937bbb8"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:09:13.978001 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-eb2649dd-f0a3-4883-ab35-bdb3e8c6853b tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:13.978632 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-eb2649dd-f0a3-4883-ab35-bdb3e8c6853b tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:13.995999 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-d153ae5e-8a6c-4e3f-b660-2712b86b9f01 req-c45efedc-d23c-42de-8e19-778424367b81 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:13.996455 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-d153ae5e-8a6c-4e3f-b660-2712b86b9f01 req-c45efedc-d23c-42de-8e19-778424367b81 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:14.023889 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-d153ae5e-8a6c-4e3f-b660-2712b86b9f01 req-c45efedc-d23c-42de-8e19-778424367b81 service nova] Creating event network-changed:5a1d4ccd-d32e-4fbf-9325-25b20937bbb8 for instance 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d on hv-cinder-84841 Jul 04 10:09:14.033167 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-d153ae5e-8a6c-4e3f-b660-2712b86b9f01 req-c45efedc-d23c-42de-8e19-778424367b81 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059568 Jul 04 10:09:14.039364 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 31/63] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:09:14.049264 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-086f4295-cb13-4944-8297-1536f94b664e tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:14.056121 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-086f4295-cb13-4944-8297-1536f94b664e tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] [instance: e8df803a-688f-4388-836b-8a16ccc26eba] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:14.073340 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-086f4295-cb13-4944-8297-1536f94b664e tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:14.074053 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-086f4295-cb13-4944-8297-1536f94b664e tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:14.075474 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-086f4295-cb13-4944-8297-1536f94b664e tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:14.086834 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-086f4295-cb13-4944-8297-1536f94b664e tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:15.008159 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell0:SELECT=4 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:15.281559 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-eb2649dd-f0a3-4883-ab35-bdb3e8c6853b tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:15.291785 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-eb2649dd-f0a3-4883-ab35-bdb3e8c6853b tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1363 microversion: 2.1 time: 1.328704 Jul 04 10:09:15.293160 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 33/64] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:13 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1363 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:15.311893 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-a9e3bf5c-66c4-4b05-a534-3c74add3c177 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:15.313566 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-a9e3bf5c-66c4-4b05-a534-3c74add3c177 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:15.321390 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a9e3bf5c-66c4-4b05-a534-3c74add3c177 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:15.321863 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a9e3bf5c-66c4-4b05-a534-3c74add3c177 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:15.323008 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a9e3bf5c-66c4-4b05-a534-3c74add3c177 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:15.323579 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a9e3bf5c-66c4-4b05-a534-3c74add3c177 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:15.423154 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-086f4295-cb13-4944-8297-1536f94b664e tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64835c93d17543668a8039caeeaa393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f718c1e8ae45dbb633172c0ba74c5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:15.437009 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-086f4295-cb13-4944-8297-1536f94b664e tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] 10.222.0.79 "GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba" status: 200 len: 1315 microversion: 2.1 time: 1.392632 Jul 04 10:09:15.437726 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 32/65] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:14 2022] GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba => generated 1315 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:15.443775 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-88a6a7a3-292a-42f5-8299-2f6438317b44 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:15.444625 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-88a6a7a3-292a-42f5-8299-2f6438317b44 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:15.452086 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-88a6a7a3-292a-42f5-8299-2f6438317b44 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:15.452616 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-88a6a7a3-292a-42f5-8299-2f6438317b44 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:15.454344 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-88a6a7a3-292a-42f5-8299-2f6438317b44 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:15.455009 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-88a6a7a3-292a-42f5-8299-2f6438317b44 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:15.702592 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-a9e3bf5c-66c4-4b05-a534-3c74add3c177 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:15.718701 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-88a6a7a3-292a-42f5-8299-2f6438317b44 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:15.726108 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-a9e3bf5c-66c4-4b05-a534-3c74add3c177 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:15.727220 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-88a6a7a3-292a-42f5-8299-2f6438317b44 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1322 microversion: 2.1 time: 0.288263 Jul 04 10:09:15.727866 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-a9e3bf5c-66c4-4b05-a534-3c74add3c177 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:15.728141 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 33/66] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:15 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:15.728991 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-a9e3bf5c-66c4-4b05-a534-3c74add3c177 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1407 microversion: 2.20 time: 0.434015 Jul 04 10:09:15.736902 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 34/67] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:09:15 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1407 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:09:15.746801 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8af0afd8-0202-4f32-993d-f15b7fc17010 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:15.747410 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-8af0afd8-0202-4f32-993d-f15b7fc17010 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:15.754401 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8af0afd8-0202-4f32-993d-f15b7fc17010 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:15.754849 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8af0afd8-0202-4f32-993d-f15b7fc17010 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:15.755631 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8af0afd8-0202-4f32-993d-f15b7fc17010 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:15.756059 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8af0afd8-0202-4f32-993d-f15b7fc17010 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:15.831100 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-0731a22c-8222-496e-bfcc-1d17671b1ec8 req-480e07ef-ddb3-4590-922e-a15ef0a66e07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89a2c77a-967c-4273-a92c-1dbd36cda2dd", "name": "network-vif-plugged", "status": "completed", "tag": "f62e5e86-0d6c-4e20-bd83-d59470ae870f"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:09:15.843440 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-0731a22c-8222-496e-bfcc-1d17671b1ec8 req-480e07ef-ddb3-4590-922e-a15ef0a66e07 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:15.846097 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-0731a22c-8222-496e-bfcc-1d17671b1ec8 req-480e07ef-ddb3-4590-922e-a15ef0a66e07 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:15.866023 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-0731a22c-8222-496e-bfcc-1d17671b1ec8 req-480e07ef-ddb3-4590-922e-a15ef0a66e07 service nova] Creating event network-vif-plugged:f62e5e86-0d6c-4e20-bd83-d59470ae870f for instance 89a2c77a-967c-4273-a92c-1dbd36cda2dd on hv-cinder-84841 Jul 04 10:09:15.872043 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-0731a22c-8222-496e-bfcc-1d17671b1ec8 req-480e07ef-ddb3-4590-922e-a15ef0a66e07 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133621 Jul 04 10:09:15.872704 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 35/68] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:09:15.884750 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-430eff9b-1953-4f09-9e23-e0c6bab5893d req-0a263f6a-659f-479f-bcba-a16867eda223 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2", "tag": "ca00e905-cd23-4f89-b9a3-2e4d9b7e6b31"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:09:15.893934 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-430eff9b-1953-4f09-9e23-e0c6bab5893d req-0a263f6a-659f-479f-bcba-a16867eda223 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:15.894591 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-430eff9b-1953-4f09-9e23-e0c6bab5893d req-0a263f6a-659f-479f-bcba-a16867eda223 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:15.906553 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-430eff9b-1953-4f09-9e23-e0c6bab5893d req-0a263f6a-659f-479f-bcba-a16867eda223 service nova] Creating event network-changed:ca00e905-cd23-4f89-b9a3-2e4d9b7e6b31 for instance ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 on hv-cinder-84841 Jul 04 10:09:15.911286 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=36 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:15.913748 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-430eff9b-1953-4f09-9e23-e0c6bab5893d req-0a263f6a-659f-479f-bcba-a16867eda223 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039375 Jul 04 10:09:15.917932 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 36/69] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:09:15.920261 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-8af0afd8-0202-4f32-993d-f15b7fc17010 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:15.930188 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-8af0afd8-0202-4f32-993d-f15b7fc17010 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d" status: 200 len: 1367 microversion: 2.1 time: 0.200895 Jul 04 10:09:15.930973 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 34/70] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:15 2022] GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:16.310304 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-ce946ec7-6ee0-44fa-b140-20e0df75dad3 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:16.311098 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-ce946ec7-6ee0-44fa-b140-20e0df75dad3 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:16.325944 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ce946ec7-6ee0-44fa-b140-20e0df75dad3 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:16.326732 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ce946ec7-6ee0-44fa-b140-20e0df75dad3 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:16.327685 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ce946ec7-6ee0-44fa-b140-20e0df75dad3 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:16.328505 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ce946ec7-6ee0-44fa-b140-20e0df75dad3 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:16.462594 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-51400050-a54d-4a6a-b7a6-8ff00ae8127f tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:16.477234 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-51400050-a54d-4a6a-b7a6-8ff00ae8127f tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] [instance: e8df803a-688f-4388-836b-8a16ccc26eba] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:16.487760 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-51400050-a54d-4a6a-b7a6-8ff00ae8127f tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:16.488693 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-51400050-a54d-4a6a-b7a6-8ff00ae8127f tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:16.490238 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-51400050-a54d-4a6a-b7a6-8ff00ae8127f tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:16.491391 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-51400050-a54d-4a6a-b7a6-8ff00ae8127f tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:16.556572 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-ce946ec7-6ee0-44fa-b140-20e0df75dad3 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:16.579048 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-ce946ec7-6ee0-44fa-b140-20e0df75dad3 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1363 microversion: 2.1 time: 0.273073 Jul 04 10:09:16.592527 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 37/71] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:16 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1363 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:16.724412 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-51400050-a54d-4a6a-b7a6-8ff00ae8127f tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64835c93d17543668a8039caeeaa393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f718c1e8ae45dbb633172c0ba74c5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:16.734079 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-51400050-a54d-4a6a-b7a6-8ff00ae8127f tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] 10.222.0.79 "GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba" status: 200 len: 1315 microversion: 2.1 time: 0.282422 Jul 04 10:09:16.738249 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 35/72] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:16 2022] GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:16.746543 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-46829206-9c4d-410f-a5f5-41cdb5a5a963 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:16.747074 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-46829206-9c4d-410f-a5f5-41cdb5a5a963 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:16.749165 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-37e5ffe7-4538-4fb5-89c6-a769e46315b1 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:16.750029 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-37e5ffe7-4538-4fb5-89c6-a769e46315b1 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:16.759367 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-46829206-9c4d-410f-a5f5-41cdb5a5a963 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:16.759813 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-46829206-9c4d-410f-a5f5-41cdb5a5a963 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:16.760575 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-46829206-9c4d-410f-a5f5-41cdb5a5a963 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:16.761150 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-46829206-9c4d-410f-a5f5-41cdb5a5a963 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:16.768195 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-37e5ffe7-4538-4fb5-89c6-a769e46315b1 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:16.772982 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-37e5ffe7-4538-4fb5-89c6-a769e46315b1 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:16.773909 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-37e5ffe7-4538-4fb5-89c6-a769e46315b1 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:16.774429 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-37e5ffe7-4538-4fb5-89c6-a769e46315b1 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:17.286147 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-46829206-9c4d-410f-a5f5-41cdb5a5a963 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:17.299370 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-46829206-9c4d-410f-a5f5-41cdb5a5a963 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1322 microversion: 2.1 time: 0.556614 Jul 04 10:09:17.299965 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 38/73] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:16 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1322 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:17.311566 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-37e5ffe7-4538-4fb5-89c6-a769e46315b1 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:17.315352 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-b1d79daf-cb86-44a6-b1f1-2d56157e7579 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:17.316483 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-b1d79daf-cb86-44a6-b1f1-2d56157e7579 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:17.322995 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-37e5ffe7-4538-4fb5-89c6-a769e46315b1 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:17.323191 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b1d79daf-cb86-44a6-b1f1-2d56157e7579 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:17.323662 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b1d79daf-cb86-44a6-b1f1-2d56157e7579 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:17.324637 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b1d79daf-cb86-44a6-b1f1-2d56157e7579 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:17.324745 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-37e5ffe7-4538-4fb5-89c6-a769e46315b1 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:17.325530 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b1d79daf-cb86-44a6-b1f1-2d56157e7579 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:17.326061 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-37e5ffe7-4538-4fb5-89c6-a769e46315b1 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1407 microversion: 2.20 time: 0.583366 Jul 04 10:09:17.326700 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 36/74] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:09:16 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1407 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:09:17.502898 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-b1d79daf-cb86-44a6-b1f1-2d56157e7579 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:17.510901 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-b1d79daf-cb86-44a6-b1f1-2d56157e7579 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d" status: 200 len: 1367 microversion: 2.1 time: 0.209876 Jul 04 10:09:17.511600 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 39/75] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:17 2022] GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:17.598900 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-37be6af9-f496-4fa9-9357-b1e7eb24f9d7 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:17.600212 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-37be6af9-f496-4fa9-9357-b1e7eb24f9d7 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:17.607580 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-37be6af9-f496-4fa9-9357-b1e7eb24f9d7 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:17.608296 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-37be6af9-f496-4fa9-9357-b1e7eb24f9d7 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:17.609220 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-37be6af9-f496-4fa9-9357-b1e7eb24f9d7 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:17.609686 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-37be6af9-f496-4fa9-9357-b1e7eb24f9d7 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:17.754778 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-df55fee2-2680-4433-b9bd-a1440e7e65ed tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:17.755269 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-df55fee2-2680-4433-b9bd-a1440e7e65ed tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] [instance: e8df803a-688f-4388-836b-8a16ccc26eba] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:17.773206 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-df55fee2-2680-4433-b9bd-a1440e7e65ed tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:17.775574 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-df55fee2-2680-4433-b9bd-a1440e7e65ed tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:17.776516 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-df55fee2-2680-4433-b9bd-a1440e7e65ed tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:17.777075 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-df55fee2-2680-4433-b9bd-a1440e7e65ed tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:17.870351 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-37be6af9-f496-4fa9-9357-b1e7eb24f9d7 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:17.879404 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-37be6af9-f496-4fa9-9357-b1e7eb24f9d7 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1363 microversion: 2.1 time: 0.284693 Jul 04 10:09:17.890709 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 37/76] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:17 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1363 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:17.905278 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-e680e806-6abf-4548-930d-32b1247d23e4 req-435af0d7-6146-46b7-85ec-5d950519a835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "068a560b-f200-4046-a36b-7ef23cea5120", "name": "network-vif-plugged", "status": "completed", "tag": "037993de-7a0b-470c-95e5-54eeb6c77200"}, {"server_uuid": "e8df803a-688f-4388-836b-8a16ccc26eba", "name": "network-vif-plugged", "status": "completed", "tag": "a30a62d5-35f1-42ed-b4ce-dbf70419be13"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:09:17.922067 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-e680e806-6abf-4548-930d-32b1247d23e4 req-435af0d7-6146-46b7-85ec-5d950519a835 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:17.922808 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-e680e806-6abf-4548-930d-32b1247d23e4 req-435af0d7-6146-46b7-85ec-5d950519a835 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:17.967695 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-e680e806-6abf-4548-930d-32b1247d23e4 req-435af0d7-6146-46b7-85ec-5d950519a835 service nova] Creating event network-vif-plugged:037993de-7a0b-470c-95e5-54eeb6c77200 for instance 068a560b-f200-4046-a36b-7ef23cea5120 on hv-cinder-84841 Jul 04 10:09:17.969038 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-e680e806-6abf-4548-930d-32b1247d23e4 req-435af0d7-6146-46b7-85ec-5d950519a835 service nova] Creating event network-vif-plugged:a30a62d5-35f1-42ed-b4ce-dbf70419be13 for instance e8df803a-688f-4388-836b-8a16ccc26eba on hv-cinder-84841 Jul 04 10:09:17.988015 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-e680e806-6abf-4548-930d-32b1247d23e4 req-435af0d7-6146-46b7-85ec-5d950519a835 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.086939 Jul 04 10:09:17.996183 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 38/77] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:09:18.318717 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-520001c5-2203-457e-ba4e-82967d7c0a37 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:18.319866 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-520001c5-2203-457e-ba4e-82967d7c0a37 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:18.333475 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-520001c5-2203-457e-ba4e-82967d7c0a37 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:18.334579 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-520001c5-2203-457e-ba4e-82967d7c0a37 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:18.335886 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-520001c5-2203-457e-ba4e-82967d7c0a37 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:18.336420 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-520001c5-2203-457e-ba4e-82967d7c0a37 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:18.361996 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=10 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:18.552672 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-df55fee2-2680-4433-b9bd-a1440e7e65ed tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64835c93d17543668a8039caeeaa393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f718c1e8ae45dbb633172c0ba74c5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:18.567458 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-df55fee2-2680-4433-b9bd-a1440e7e65ed tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] 10.222.0.79 "GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba" status: 200 len: 1315 microversion: 2.1 time: 0.817419 Jul 04 10:09:18.569724 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 40/78] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:17 2022] GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba => generated 1315 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:09:18.584241 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-91410842-954d-45c1-8728-18a254609ee9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:18.584890 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-91410842-954d-45c1-8728-18a254609ee9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:18.595015 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-91410842-954d-45c1-8728-18a254609ee9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:18.597067 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-91410842-954d-45c1-8728-18a254609ee9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:18.598375 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-91410842-954d-45c1-8728-18a254609ee9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:18.599149 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-91410842-954d-45c1-8728-18a254609ee9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:19.170681 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-520001c5-2203-457e-ba4e-82967d7c0a37 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:19.181126 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-520001c5-2203-457e-ba4e-82967d7c0a37 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1322 microversion: 2.1 time: 0.868545 Jul 04 10:09:19.182978 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 39/79] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:18 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1322 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:19.187674 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f7645b53-9ef4-48f4-b8d4-ff792f003bcc tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:19.188275 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f7645b53-9ef4-48f4-b8d4-ff792f003bcc tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:19.199919 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f7645b53-9ef4-48f4-b8d4-ff792f003bcc tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:19.200566 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f7645b53-9ef4-48f4-b8d4-ff792f003bcc tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:19.201916 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f7645b53-9ef4-48f4-b8d4-ff792f003bcc tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:19.202488 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f7645b53-9ef4-48f4-b8d4-ff792f003bcc tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:19.282967 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-91410842-954d-45c1-8728-18a254609ee9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:19.294802 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-91410842-954d-45c1-8728-18a254609ee9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:19.296331 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-91410842-954d-45c1-8728-18a254609ee9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:19.297491 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-91410842-954d-45c1-8728-18a254609ee9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1407 microversion: 2.20 time: 0.725707 Jul 04 10:09:19.303214 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 41/80] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:09:18 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1407 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:09:19.308279 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-f4dbe0b4-3534-4632-943e-b598c3f3c9c0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:19.308883 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-f4dbe0b4-3534-4632-943e-b598c3f3c9c0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:19.328309 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f4dbe0b4-3534-4632-943e-b598c3f3c9c0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:19.328799 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f4dbe0b4-3534-4632-943e-b598c3f3c9c0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:19.329582 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f4dbe0b4-3534-4632-943e-b598c3f3c9c0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:19.330077 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f4dbe0b4-3534-4632-943e-b598c3f3c9c0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:19.670334 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-f7645b53-9ef4-48f4-b8d4-ff792f003bcc tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:19.677475 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f7645b53-9ef4-48f4-b8d4-ff792f003bcc tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d" status: 200 len: 1367 microversion: 2.1 time: 0.493311 Jul 04 10:09:19.678160 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 40/81] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:19 2022] GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d => generated 1367 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:19.682929 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-cc367f87-9486-45d0-8af3-ff6880f28f21 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:19.683783 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-cc367f87-9486-45d0-8af3-ff6880f28f21 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] [instance: e8df803a-688f-4388-836b-8a16ccc26eba] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:19.690814 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cc367f87-9486-45d0-8af3-ff6880f28f21 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:19.691442 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cc367f87-9486-45d0-8af3-ff6880f28f21 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:19.692298 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cc367f87-9486-45d0-8af3-ff6880f28f21 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:19.692890 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cc367f87-9486-45d0-8af3-ff6880f28f21 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:19.708519 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-f4dbe0b4-3534-4632-943e-b598c3f3c9c0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:19.719006 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-f4dbe0b4-3534-4632-943e-b598c3f3c9c0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1363 microversion: 2.1 time: 0.414422 Jul 04 10:09:19.731216 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 42/82] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:19 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1363 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:19.875703 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-cc367f87-9486-45d0-8af3-ff6880f28f21 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64835c93d17543668a8039caeeaa393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f718c1e8ae45dbb633172c0ba74c5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:19.883623 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-cc367f87-9486-45d0-8af3-ff6880f28f21 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] 10.222.0.79 "GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba" status: 200 len: 1315 microversion: 2.1 time: 0.204349 Jul 04 10:09:19.884177 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 41/83] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:19 2022] GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:20.197868 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-ade439a6-de61-4f07-91fb-d0e4e2d92768 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:20.198626 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-ade439a6-de61-4f07-91fb-d0e4e2d92768 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:20.204580 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ade439a6-de61-4f07-91fb-d0e4e2d92768 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:20.205309 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ade439a6-de61-4f07-91fb-d0e4e2d92768 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:20.206332 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ade439a6-de61-4f07-91fb-d0e4e2d92768 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:20.206833 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ade439a6-de61-4f07-91fb-d0e4e2d92768 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:20.321009 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-3c81e5c8-29f1-4343-9019-c7f249c776a0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:20.322591 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-3c81e5c8-29f1-4343-9019-c7f249c776a0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:20.339718 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3c81e5c8-29f1-4343-9019-c7f249c776a0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:20.339901 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3c81e5c8-29f1-4343-9019-c7f249c776a0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:20.340863 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3c81e5c8-29f1-4343-9019-c7f249c776a0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:20.341299 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3c81e5c8-29f1-4343-9019-c7f249c776a0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:20.558234 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-ade439a6-de61-4f07-91fb-d0e4e2d92768 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:20.568438 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-ade439a6-de61-4f07-91fb-d0e4e2d92768 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1322 microversion: 2.1 time: 0.374333 Jul 04 10:09:20.589961 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 43/84] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:20 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1322 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:20.662534 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-3c81e5c8-29f1-4343-9019-c7f249c776a0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:20.677765 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-3c81e5c8-29f1-4343-9019-c7f249c776a0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:20.681204 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-3c81e5c8-29f1-4343-9019-c7f249c776a0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:20.685610 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-3c81e5c8-29f1-4343-9019-c7f249c776a0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1407 microversion: 2.20 time: 0.368198 Jul 04 10:09:20.686873 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 42/85] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:09:20 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1407 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 10:09:20.702228 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-73dd5fb6-6b13-422f-b2e0-2933bf3ec410 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:20.702983 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-73dd5fb6-6b13-422f-b2e0-2933bf3ec410 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:20.711343 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-73dd5fb6-6b13-422f-b2e0-2933bf3ec410 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:20.712000 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-73dd5fb6-6b13-422f-b2e0-2933bf3ec410 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:20.713104 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-73dd5fb6-6b13-422f-b2e0-2933bf3ec410 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:20.713600 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-73dd5fb6-6b13-422f-b2e0-2933bf3ec410 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:20.739717 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8dc12499-2299-4a73-a55f-435e9196e601 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:20.740333 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-8dc12499-2299-4a73-a55f-435e9196e601 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:20.749129 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8dc12499-2299-4a73-a55f-435e9196e601 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:20.749567 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8dc12499-2299-4a73-a55f-435e9196e601 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:20.750692 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8dc12499-2299-4a73-a55f-435e9196e601 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:20.751348 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8dc12499-2299-4a73-a55f-435e9196e601 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:21.115075 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-8dc12499-2299-4a73-a55f-435e9196e601 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:21.141180 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-8dc12499-2299-4a73-a55f-435e9196e601 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1363 microversion: 2.1 time: 0.405921 Jul 04 10:09:21.143612 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 43/86] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:20 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1363 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:09:21.152997 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-a8119e00-df0a-4839-bdd5-c7fafc62dca2 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:21.156985 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-a8119e00-df0a-4839-bdd5-c7fafc62dca2 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] [instance: e8df803a-688f-4388-836b-8a16ccc26eba] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:21.160898 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-73dd5fb6-6b13-422f-b2e0-2933bf3ec410 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:21.164972 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell1:SELECT=100 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:21.171384 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-73dd5fb6-6b13-422f-b2e0-2933bf3ec410 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d" status: 200 len: 1367 microversion: 2.1 time: 0.473397 Jul 04 10:09:21.172073 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 44/87] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:20 2022] GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d => generated 1367 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:21.174041 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a8119e00-df0a-4839-bdd5-c7fafc62dca2 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:21.175056 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a8119e00-df0a-4839-bdd5-c7fafc62dca2 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:21.176545 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a8119e00-df0a-4839-bdd5-c7fafc62dca2 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:21.177581 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a8119e00-df0a-4839-bdd5-c7fafc62dca2 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:21.183185 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-c39f0d0c-9c65-4267-a815-a43dcb25e86e req-982c0bc8-77ab-4dc2-8ce5-cbc483ec7511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a842f878-2275-4988-8e51-b3b7276678e7", "name": "network-vif-plugged", "status": "completed", "tag": "2172e408-c0ad-454d-89dc-0a5bd85b15cb"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:09:21.203520 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-c39f0d0c-9c65-4267-a815-a43dcb25e86e req-982c0bc8-77ab-4dc2-8ce5-cbc483ec7511 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:21.204334 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-c39f0d0c-9c65-4267-a815-a43dcb25e86e req-982c0bc8-77ab-4dc2-8ce5-cbc483ec7511 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:21.231556 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-c39f0d0c-9c65-4267-a815-a43dcb25e86e req-982c0bc8-77ab-4dc2-8ce5-cbc483ec7511 service nova] Creating event network-vif-plugged:2172e408-c0ad-454d-89dc-0a5bd85b15cb for instance a842f878-2275-4988-8e51-b3b7276678e7 on hv-cinder-84841 Jul 04 10:09:21.237039 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-c39f0d0c-9c65-4267-a815-a43dcb25e86e req-982c0bc8-77ab-4dc2-8ce5-cbc483ec7511 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063315 Jul 04 10:09:21.238230 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 45/88] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:09:21.448250 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-a8119e00-df0a-4839-bdd5-c7fafc62dca2 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64835c93d17543668a8039caeeaa393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f718c1e8ae45dbb633172c0ba74c5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:21.461172 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-a8119e00-df0a-4839-bdd5-c7fafc62dca2 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] 10.222.0.79 "GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba" status: 200 len: 1502 microversion: 2.1 time: 0.316154 Jul 04 10:09:21.462219 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 44/89] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:21 2022] GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba => generated 1502 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:21.586729 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-2f697353-0d1d-4f53-b557-e776941bceab tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:21.587540 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-2f697353-0d1d-4f53-b557-e776941bceab tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:21.600561 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2f697353-0d1d-4f53-b557-e776941bceab tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:21.601410 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2f697353-0d1d-4f53-b557-e776941bceab tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:21.603171 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2f697353-0d1d-4f53-b557-e776941bceab tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:21.605054 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2f697353-0d1d-4f53-b557-e776941bceab tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:21.703739 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-6ff5eb22-03c9-44b5-934a-9a8f6cfb2a46 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:21.704344 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-6ff5eb22-03c9-44b5-934a-9a8f6cfb2a46 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:21.715470 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6ff5eb22-03c9-44b5-934a-9a8f6cfb2a46 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:21.715939 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6ff5eb22-03c9-44b5-934a-9a8f6cfb2a46 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:21.716885 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6ff5eb22-03c9-44b5-934a-9a8f6cfb2a46 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:21.721355 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6ff5eb22-03c9-44b5-934a-9a8f6cfb2a46 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:21.731784 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=100 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:21.831821 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-2f697353-0d1d-4f53-b557-e776941bceab tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:21.848872 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-2f697353-0d1d-4f53-b557-e776941bceab tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1515 microversion: 2.1 time: 0.264485 Jul 04 10:09:21.851209 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 46/90] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:21 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1515 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:21.869658 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-5f4b2409-f9d2-4b02-8f81-1fbb18400b80 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:09:21.871137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-5f4b2409-f9d2-4b02-8f81-1fbb18400b80 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:21.889984 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5f4b2409-f9d2-4b02-8f81-1fbb18400b80 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:21.890635 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5f4b2409-f9d2-4b02-8f81-1fbb18400b80 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:21.893994 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5f4b2409-f9d2-4b02-8f81-1fbb18400b80 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:21.897159 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5f4b2409-f9d2-4b02-8f81-1fbb18400b80 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:21.994626 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-6ff5eb22-03c9-44b5-934a-9a8f6cfb2a46 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:22.004379 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-6ff5eb22-03c9-44b5-934a-9a8f6cfb2a46 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:22.006209 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-6ff5eb22-03c9-44b5-934a-9a8f6cfb2a46 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:22.007336 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-6ff5eb22-03c9-44b5-934a-9a8f6cfb2a46 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1407 microversion: 2.20 time: 0.307543 Jul 04 10:09:22.017648 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 45/91] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:09:21 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1407 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 10:09:22.050109 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.objects.instance [None req-5f4b2409-f9d2-4b02-8f81-1fbb18400b80 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lazy-loading 'flavor' on Instance uuid 89a2c77a-967c-4273-a92c-1dbd36cda2dd {{(pid=117866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 10:09:22.160656 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-905ea6da-7953-47e7-9f62-ea0f76503290 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:22.161433 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-905ea6da-7953-47e7-9f62-ea0f76503290 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:22.167942 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-905ea6da-7953-47e7-9f62-ea0f76503290 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:22.168393 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-905ea6da-7953-47e7-9f62-ea0f76503290 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:22.169165 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-905ea6da-7953-47e7-9f62-ea0f76503290 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:22.169596 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-905ea6da-7953-47e7-9f62-ea0f76503290 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:22.212123 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-5f4b2409-f9d2-4b02-8f81-1fbb18400b80 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "POST /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd/action" status: 200 len: 32 microversion: 2.1 time: 0.348556 Jul 04 10:09:22.213896 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 47/92] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Jul 4 10:09:21 2022] POST /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd/action => generated 32 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 10:09:22.222275 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-8e6d45de-6386-4c49-9aa2-6e0d9246b027 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:22.223226 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-8e6d45de-6386-4c49-9aa2-6e0d9246b027 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:22.230587 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8e6d45de-6386-4c49-9aa2-6e0d9246b027 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:22.231122 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8e6d45de-6386-4c49-9aa2-6e0d9246b027 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:22.231962 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8e6d45de-6386-4c49-9aa2-6e0d9246b027 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:22.232459 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8e6d45de-6386-4c49-9aa2-6e0d9246b027 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:22.378317 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-905ea6da-7953-47e7-9f62-ea0f76503290 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:22.387016 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-905ea6da-7953-47e7-9f62-ea0f76503290 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1363 microversion: 2.1 time: 0.232160 Jul 04 10:09:22.391845 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 46/93] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:22 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:22.405692 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-0f8352f4-9d40-4241-a38f-b650101bb7d0 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:22.406640 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-0f8352f4-9d40-4241-a38f-b650101bb7d0 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:22.414873 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0f8352f4-9d40-4241-a38f-b650101bb7d0 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:22.415829 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0f8352f4-9d40-4241-a38f-b650101bb7d0 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:22.419511 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0f8352f4-9d40-4241-a38f-b650101bb7d0 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:22.420657 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0f8352f4-9d40-4241-a38f-b650101bb7d0 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:22.505258 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-8e6d45de-6386-4c49-9aa2-6e0d9246b027 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:22.514236 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-8e6d45de-6386-4c49-9aa2-6e0d9246b027 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d" status: 200 len: 1367 microversion: 2.1 time: 0.296925 Jul 04 10:09:22.536270 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 48/94] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:22 2022] GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d => generated 1367 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:22.775792 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-0f8352f4-9d40-4241-a38f-b650101bb7d0 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:22.784585 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-0f8352f4-9d40-4241-a38f-b650101bb7d0 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.391318 Jul 04 10:09:22.785770 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 47/95] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:22 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:23.031511 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-14162e0e-bbd5-46d0-89c9-0be8f160ff79 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:23.032161 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-14162e0e-bbd5-46d0-89c9-0be8f160ff79 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:23.039469 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-14162e0e-bbd5-46d0-89c9-0be8f160ff79 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:23.040001 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-14162e0e-bbd5-46d0-89c9-0be8f160ff79 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:23.040901 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-14162e0e-bbd5-46d0-89c9-0be8f160ff79 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:23.041400 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-14162e0e-bbd5-46d0-89c9-0be8f160ff79 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:23.137967 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-4d904350-39df-44c1-87e1-2dbb7f4c3879 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba9f7c64-5a49-497f-bd54-9e02c2c065fb"}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:09:23.139164 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-4d904350-39df-44c1-87e1-2dbb7f4c3879 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] [instance: e8df803a-688f-4388-836b-8a16ccc26eba] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:23.148634 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4d904350-39df-44c1-87e1-2dbb7f4c3879 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:23.149055 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4d904350-39df-44c1-87e1-2dbb7f4c3879 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:23.153167 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4d904350-39df-44c1-87e1-2dbb7f4c3879 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:23.153658 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4d904350-39df-44c1-87e1-2dbb7f4c3879 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:23.263231 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-14162e0e-bbd5-46d0-89c9-0be8f160ff79 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:23.276675 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-14162e0e-bbd5-46d0-89c9-0be8f160ff79 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:23.278506 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-14162e0e-bbd5-46d0-89c9-0be8f160ff79 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:23.279630 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-14162e0e-bbd5-46d0-89c9-0be8f160ff79 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1407 microversion: 2.20 time: 0.252221 Jul 04 10:09:23.280183 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 49/96] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:09:23 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:09:23.294376 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-ba8381fb-a4dc-430c-ac89-8aee78a3b267 req-28c6ed35-618e-4fe4-92de-dc18a4db7b13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2", "name": "network-vif-plugged", "status": "completed", "tag": "ca00e905-cd23-4f89-b9a3-2e4d9b7e6b31"}, {"server_uuid": "9659bd27-cdfe-44b1-9ffe-bec5319c9b5d", "name": "network-vif-plugged", "status": "completed", "tag": "5a1d4ccd-d32e-4fbf-9325-25b20937bbb8"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:09:23.312924 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-ba8381fb-a4dc-430c-ac89-8aee78a3b267 req-28c6ed35-618e-4fe4-92de-dc18a4db7b13 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:23.314584 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-ba8381fb-a4dc-430c-ac89-8aee78a3b267 req-28c6ed35-618e-4fe4-92de-dc18a4db7b13 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:23.328513 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-ba8381fb-a4dc-430c-ac89-8aee78a3b267 req-28c6ed35-618e-4fe4-92de-dc18a4db7b13 service nova] Creating event network-vif-plugged:ca00e905-cd23-4f89-b9a3-2e4d9b7e6b31 for instance ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 on hv-cinder-84841 Jul 04 10:09:23.329094 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-ba8381fb-a4dc-430c-ac89-8aee78a3b267 req-28c6ed35-618e-4fe4-92de-dc18a4db7b13 service nova] Creating event network-vif-plugged:5a1d4ccd-d32e-4fbf-9325-25b20937bbb8 for instance 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d on hv-cinder-84841 Jul 04 10:09:23.336447 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-ba8381fb-a4dc-430c-ac89-8aee78a3b267 req-28c6ed35-618e-4fe4-92de-dc18a4db7b13 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053144 Jul 04 10:09:23.342137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 50/97] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:09:23.413693 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-0aff70e6-ccb0-4764-bbff-265188baf093 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:23.414533 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-0aff70e6-ccb0-4764-bbff-265188baf093 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:23.420981 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0aff70e6-ccb0-4764-bbff-265188baf093 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:23.421680 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0aff70e6-ccb0-4764-bbff-265188baf093 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:23.422972 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0aff70e6-ccb0-4764-bbff-265188baf093 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:23.423661 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0aff70e6-ccb0-4764-bbff-265188baf093 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:23.586750 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-0aff70e6-ccb0-4764-bbff-265188baf093 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:23.594888 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-0aff70e6-ccb0-4764-bbff-265188baf093 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1363 microversion: 2.1 time: 0.185489 Jul 04 10:09:23.595522 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 51/98] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:23 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:23.600458 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-77098410-e00f-4262-a68d-6f8dfad33bb1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:23.601089 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-77098410-e00f-4262-a68d-6f8dfad33bb1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:23.607080 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-77098410-e00f-4262-a68d-6f8dfad33bb1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:23.607802 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-77098410-e00f-4262-a68d-6f8dfad33bb1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:23.608558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-77098410-e00f-4262-a68d-6f8dfad33bb1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:23.609007 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-77098410-e00f-4262-a68d-6f8dfad33bb1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:23.860661 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-77098410-e00f-4262-a68d-6f8dfad33bb1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:23.870408 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-77098410-e00f-4262-a68d-6f8dfad33bb1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d" status: 200 len: 1367 microversion: 2.1 time: 0.272782 Jul 04 10:09:23.871643 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 52/99] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:23 2022] GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d => generated 1367 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:23.877197 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-aec2de43-85f1-4061-a7c5-3ca2353e911f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:23.878146 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-aec2de43-85f1-4061-a7c5-3ca2353e911f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:23.885189 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-aec2de43-85f1-4061-a7c5-3ca2353e911f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:23.885768 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-aec2de43-85f1-4061-a7c5-3ca2353e911f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:23.886613 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-aec2de43-85f1-4061-a7c5-3ca2353e911f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:23.887134 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-aec2de43-85f1-4061-a7c5-3ca2353e911f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:24.046210 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-4d904350-39df-44c1-87e1-2dbb7f4c3879 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] 10.222.0.79 "POST /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.913729 Jul 04 10:09:24.047411 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 48/100] 10.222.0.79 () {60 vars in 1322 bytes} [Mon Jul 4 10:09:23 2022] POST /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba/os-volume_attachments => generated 194 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:09:24.108423 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-aec2de43-85f1-4061-a7c5-3ca2353e911f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:24.117194 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-aec2de43-85f1-4061-a7c5-3ca2353e911f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.244175 Jul 04 10:09:24.117789 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 53/101] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:23 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:24.302647 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-4d68a923-5b63-46e2-9011-3164de8c3362 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:24.303337 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-4d68a923-5b63-46e2-9011-3164de8c3362 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:24.312797 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4d68a923-5b63-46e2-9011-3164de8c3362 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:24.313352 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4d68a923-5b63-46e2-9011-3164de8c3362 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:24.314243 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4d68a923-5b63-46e2-9011-3164de8c3362 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:24.314774 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4d68a923-5b63-46e2-9011-3164de8c3362 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:24.590975 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-4d68a923-5b63-46e2-9011-3164de8c3362 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:24.616759 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-4d68a923-5b63-46e2-9011-3164de8c3362 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:24.618593 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-4d68a923-5b63-46e2-9011-3164de8c3362 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:24.619856 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-1734f0b3-62dd-4c7d-b6a3-3949ec1d288e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:24.620505 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-1734f0b3-62dd-4c7d-b6a3-3949ec1d288e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:24.624046 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-4d68a923-5b63-46e2-9011-3164de8c3362 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1407 microversion: 2.20 time: 0.325589 Jul 04 10:09:24.625403 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 49/102] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:09:24 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1407 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:09:24.627628 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1734f0b3-62dd-4c7d-b6a3-3949ec1d288e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:24.628140 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1734f0b3-62dd-4c7d-b6a3-3949ec1d288e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:24.629347 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1734f0b3-62dd-4c7d-b6a3-3949ec1d288e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:24.629946 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1734f0b3-62dd-4c7d-b6a3-3949ec1d288e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:24.870212 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-1734f0b3-62dd-4c7d-b6a3-3949ec1d288e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:24.878778 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-1734f0b3-62dd-4c7d-b6a3-3949ec1d288e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1549 microversion: 2.1 time: 0.270666 Jul 04 10:09:24.879369 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 54/103] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:24 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1549 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:09:24.888013 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-efccd0a8-9ac9-4460-bc98-2c525f7521fb tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:24.888858 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-efccd0a8-9ac9-4460-bc98-2c525f7521fb tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:24.897116 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-efccd0a8-9ac9-4460-bc98-2c525f7521fb tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:24.897565 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-efccd0a8-9ac9-4460-bc98-2c525f7521fb tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:24.898379 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-efccd0a8-9ac9-4460-bc98-2c525f7521fb tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:24.898806 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-efccd0a8-9ac9-4460-bc98-2c525f7521fb tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:24.904083 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-cb00b31e-d6c9-450b-93b2-ea202e672d3a tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:24.904573 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-cb00b31e-d6c9-450b-93b2-ea202e672d3a tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:24.919583 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-cb00b31e-d6c9-450b-93b2-ea202e672d3a tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:24.920064 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-cb00b31e-d6c9-450b-93b2-ea202e672d3a tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:24.921009 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-cb00b31e-d6c9-450b-93b2-ea202e672d3a tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:24.921578 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-cb00b31e-d6c9-450b-93b2-ea202e672d3a tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:25.061289 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-cb00b31e-d6c9-450b-93b2-ea202e672d3a tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.167680 Jul 04 10:09:25.062435 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 55/104] 10.222.0.79 () {58 vars in 1274 bytes} [Mon Jul 4 10:09:24 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7/os-interface => generated 285 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:09:25.118590 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-efccd0a8-9ac9-4460-bc98-2c525f7521fb tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:25.138229 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-efccd0a8-9ac9-4460-bc98-2c525f7521fb tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d" status: 200 len: 1367 microversion: 2.1 time: 0.253939 Jul 04 10:09:25.140145 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 50/105] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:24 2022] GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:09:25.144854 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-29a4e49b-1686-416e-acb5-4c2a2086c033 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:25.145480 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-29a4e49b-1686-416e-acb5-4c2a2086c033 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:25.154969 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-29a4e49b-1686-416e-acb5-4c2a2086c033 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:25.155513 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-29a4e49b-1686-416e-acb5-4c2a2086c033 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:25.156661 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-29a4e49b-1686-416e-acb5-4c2a2086c033 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:25.157298 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-29a4e49b-1686-416e-acb5-4c2a2086c033 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:25.319424 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-29a4e49b-1686-416e-acb5-4c2a2086c033 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:25.330129 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-29a4e49b-1686-416e-acb5-4c2a2086c033 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.192544 Jul 04 10:09:25.340702 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 56/106] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:25 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:25.643586 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-40b99a54-3e79-4a5d-91f5-1d5114ba790e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:25.644415 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-40b99a54-3e79-4a5d-91f5-1d5114ba790e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:25.650570 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-40b99a54-3e79-4a5d-91f5-1d5114ba790e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:25.651218 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-40b99a54-3e79-4a5d-91f5-1d5114ba790e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:25.652918 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-40b99a54-3e79-4a5d-91f5-1d5114ba790e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:25.653684 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-40b99a54-3e79-4a5d-91f5-1d5114ba790e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:25.812664 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-40b99a54-3e79-4a5d-91f5-1d5114ba790e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:25.824327 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-40b99a54-3e79-4a5d-91f5-1d5114ba790e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:25.825855 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-40b99a54-3e79-4a5d-91f5-1d5114ba790e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:25.826961 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-40b99a54-3e79-4a5d-91f5-1d5114ba790e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1407 microversion: 2.20 time: 0.187802 Jul 04 10:09:25.829815 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 51/107] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:09:25 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:09:26.159695 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-706d8a11-67c8-45ef-baa9-7db09da6d8f6 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:26.160409 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-706d8a11-67c8-45ef-baa9-7db09da6d8f6 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:26.168137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-706d8a11-67c8-45ef-baa9-7db09da6d8f6 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:26.168919 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-706d8a11-67c8-45ef-baa9-7db09da6d8f6 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:26.169884 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-706d8a11-67c8-45ef-baa9-7db09da6d8f6 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:26.170504 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-706d8a11-67c8-45ef-baa9-7db09da6d8f6 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:26.350326 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b4a9d491-914b-4940-9901-5f3833e2df17 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:26.351790 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-b4a9d491-914b-4940-9901-5f3833e2df17 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:26.362153 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b4a9d491-914b-4940-9901-5f3833e2df17 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:26.363341 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b4a9d491-914b-4940-9901-5f3833e2df17 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:26.364529 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b4a9d491-914b-4940-9901-5f3833e2df17 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:26.365307 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b4a9d491-914b-4940-9901-5f3833e2df17 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:26.369669 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-706d8a11-67c8-45ef-baa9-7db09da6d8f6 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:26.383954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-706d8a11-67c8-45ef-baa9-7db09da6d8f6 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d" status: 200 len: 1367 microversion: 2.1 time: 0.231200 Jul 04 10:09:26.384647 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 57/108] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:26 2022] GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:26.623713 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-82a5f6cb-f5f9-463f-be66-7e15e5f202da req-66dfa4d8-f56f-44ca-a2a3-9a5a09faaaa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a842f878-2275-4988-8e51-b3b7276678e7", "tag": "2172e408-c0ad-454d-89dc-0a5bd85b15cb"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:09:26.625985 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-b4a9d491-914b-4940-9901-5f3833e2df17 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:26.635695 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-82a5f6cb-f5f9-463f-be66-7e15e5f202da req-66dfa4d8-f56f-44ca-a2a3-9a5a09faaaa2 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:26.636106 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-b4a9d491-914b-4940-9901-5f3833e2df17 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.291858 Jul 04 10:09:26.636215 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-82a5f6cb-f5f9-463f-be66-7e15e5f202da req-66dfa4d8-f56f-44ca-a2a3-9a5a09faaaa2 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:26.636704 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 52/109] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:26 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:09:26.663162 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-82a5f6cb-f5f9-463f-be66-7e15e5f202da req-66dfa4d8-f56f-44ca-a2a3-9a5a09faaaa2 service nova] Creating event network-changed:2172e408-c0ad-454d-89dc-0a5bd85b15cb for instance a842f878-2275-4988-8e51-b3b7276678e7 on hv-cinder-84841 Jul 04 10:09:26.670892 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-82a5f6cb-f5f9-463f-be66-7e15e5f202da req-66dfa4d8-f56f-44ca-a2a3-9a5a09faaaa2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050899 Jul 04 10:09:26.672847 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 58/110] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 10:09:26.845328 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-40d9ef1d-698d-4d6f-8ed2-249ddc8fa690 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:26.846012 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-40d9ef1d-698d-4d6f-8ed2-249ddc8fa690 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:26.852271 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-40d9ef1d-698d-4d6f-8ed2-249ddc8fa690 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:26.852719 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-40d9ef1d-698d-4d6f-8ed2-249ddc8fa690 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:26.853499 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-40d9ef1d-698d-4d6f-8ed2-249ddc8fa690 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:26.853983 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-40d9ef1d-698d-4d6f-8ed2-249ddc8fa690 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:27.075760 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-40d9ef1d-698d-4d6f-8ed2-249ddc8fa690 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:27.085362 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-40d9ef1d-698d-4d6f-8ed2-249ddc8fa690 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:27.087248 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-40d9ef1d-698d-4d6f-8ed2-249ddc8fa690 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:27.088957 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-40d9ef1d-698d-4d6f-8ed2-249ddc8fa690 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1407 microversion: 2.20 time: 0.247940 Jul 04 10:09:27.089568 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 53/111] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:09:26 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:09:27.402705 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-abffd51d-60be-4334-bba2-eb3558b991f9 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:27.404039 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-abffd51d-60be-4334-bba2-eb3558b991f9 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:27.410747 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-abffd51d-60be-4334-bba2-eb3558b991f9 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:27.411190 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-abffd51d-60be-4334-bba2-eb3558b991f9 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:27.412151 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-abffd51d-60be-4334-bba2-eb3558b991f9 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:27.413211 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-abffd51d-60be-4334-bba2-eb3558b991f9 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:27.559669 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-abffd51d-60be-4334-bba2-eb3558b991f9 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:27.577832 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-abffd51d-60be-4334-bba2-eb3558b991f9 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d" status: 200 len: 1367 microversion: 2.1 time: 0.179503 Jul 04 10:09:27.582721 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 59/112] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:27 2022] GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:27.655666 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-931856df-eb3b-4370-ae62-aca10099a228 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:27.656762 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-931856df-eb3b-4370-ae62-aca10099a228 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:27.667897 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-931856df-eb3b-4370-ae62-aca10099a228 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:27.668347 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-931856df-eb3b-4370-ae62-aca10099a228 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:27.669119 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-931856df-eb3b-4370-ae62-aca10099a228 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:27.669566 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-931856df-eb3b-4370-ae62-aca10099a228 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:27.813663 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-931856df-eb3b-4370-ae62-aca10099a228 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:27.821980 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-931856df-eb3b-4370-ae62-aca10099a228 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.170803 Jul 04 10:09:27.822600 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 54/113] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:27 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:28.107925 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-69977bd2-5c2e-406f-97c2-c0c350e523f9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:28.108555 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-69977bd2-5c2e-406f-97c2-c0c350e523f9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:28.115519 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-69977bd2-5c2e-406f-97c2-c0c350e523f9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:28.115968 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-69977bd2-5c2e-406f-97c2-c0c350e523f9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:28.116732 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-69977bd2-5c2e-406f-97c2-c0c350e523f9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:28.117156 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-69977bd2-5c2e-406f-97c2-c0c350e523f9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:28.260835 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-69977bd2-5c2e-406f-97c2-c0c350e523f9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:28.270332 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-69977bd2-5c2e-406f-97c2-c0c350e523f9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:28.272211 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-69977bd2-5c2e-406f-97c2-c0c350e523f9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:28.273976 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-69977bd2-5c2e-406f-97c2-c0c350e523f9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1407 microversion: 2.20 time: 0.170090 Jul 04 10:09:28.284227 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 60/114] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:09:28 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:09:28.600275 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f57ccf31-291e-44ba-b8b5-5013e1327b4b tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:28.600810 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f57ccf31-291e-44ba-b8b5-5013e1327b4b tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:28.607135 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f57ccf31-291e-44ba-b8b5-5013e1327b4b tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:28.607619 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f57ccf31-291e-44ba-b8b5-5013e1327b4b tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:28.608339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f57ccf31-291e-44ba-b8b5-5013e1327b4b tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:28.608859 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f57ccf31-291e-44ba-b8b5-5013e1327b4b tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:28.734289 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-452d9c72-dd3e-4dcc-93cd-e6e7a6990b2b tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1378063657", "imageRef": "80bd29b0-b77c-4611-be31-69ca559a2d2a", "flavorRef": "452", "networks": [{"uuid": "b221b5cf-f562-4b2f-a2b8-71ec29c35306"}]}} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:09:28.758073 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-f57ccf31-291e-44ba-b8b5-5013e1327b4b tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:28.773428 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f57ccf31-291e-44ba-b8b5-5013e1327b4b tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d" status: 200 len: 1367 microversion: 2.1 time: 0.176819 Jul 04 10:09:28.774235 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 55/115] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:28 2022] GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:28.794709 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.network.neutron [None req-452d9c72-dd3e-4dcc-93cd-e6e7a6990b2b tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] validate_networks() for [('b221b5cf-f562-4b2f-a2b8-71ec29c35306', None, None, None, None, None)] {{(pid=117866) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 10:09:28.839129 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8f3f0c76-50bb-4c84-ac11-c20a6d431191 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:28.839732 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-8f3f0c76-50bb-4c84-ac11-c20a6d431191 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:28.846329 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8f3f0c76-50bb-4c84-ac11-c20a6d431191 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:28.847184 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8f3f0c76-50bb-4c84-ac11-c20a6d431191 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:28.848415 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8f3f0c76-50bb-4c84-ac11-c20a6d431191 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:28.849087 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8f3f0c76-50bb-4c84-ac11-c20a6d431191 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:29.346062 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-8f3f0c76-50bb-4c84-ac11-c20a6d431191 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:29.355562 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-8f3f0c76-50bb-4c84-ac11-c20a6d431191 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.520162 Jul 04 10:09:29.356157 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 56/116] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:28 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:09:29.369815 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-3c3a16e8-32f1-4eae-83d3-8f4908bb9569 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:29.370599 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-3c3a16e8-32f1-4eae-83d3-8f4908bb9569 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:29.376919 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3c3a16e8-32f1-4eae-83d3-8f4908bb9569 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:29.377554 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3c3a16e8-32f1-4eae-83d3-8f4908bb9569 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:29.378356 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3c3a16e8-32f1-4eae-83d3-8f4908bb9569 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:29.378787 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3c3a16e8-32f1-4eae-83d3-8f4908bb9569 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:29.600059 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-3c3a16e8-32f1-4eae-83d3-8f4908bb9569 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:29.608625 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-3c3a16e8-32f1-4eae-83d3-8f4908bb9569 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:29.610136 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-3c3a16e8-32f1-4eae-83d3-8f4908bb9569 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:29.611278 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-3c3a16e8-32f1-4eae-83d3-8f4908bb9569 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1597 microversion: 2.20 time: 0.245385 Jul 04 10:09:29.611839 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 57/117] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:09:29 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1597 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:09:29.622516 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-452d9c72-dd3e-4dcc-93cd-e6e7a6990b2b tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Flavor limits 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 10:09:29.622516 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-452d9c72-dd3e-4dcc-93cd-e6e7a6990b2b tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Image limits 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 10:09:29.623044 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-452d9c72-dd3e-4dcc-93cd-e6e7a6990b2b tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Flavor pref 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 10:09:29.623695 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-452d9c72-dd3e-4dcc-93cd-e6e7a6990b2b tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Image pref 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 10:09:29.624280 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-452d9c72-dd3e-4dcc-93cd-e6e7a6990b2b tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 10:09:29.630258 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-65760bf7-35f3-4d7c-80ff-795a1464d376 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:29.630740 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-65760bf7-35f3-4d7c-80ff-795a1464d376 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:29.634028 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-452d9c72-dd3e-4dcc-93cd-e6e7a6990b2b tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:29.634482 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-452d9c72-dd3e-4dcc-93cd-e6e7a6990b2b tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:29.635285 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-452d9c72-dd3e-4dcc-93cd-e6e7a6990b2b tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:29.635673 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-452d9c72-dd3e-4dcc-93cd-e6e7a6990b2b tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:29.637297 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-65760bf7-35f3-4d7c-80ff-795a1464d376 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:29.637838 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-65760bf7-35f3-4d7c-80ff-795a1464d376 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:29.638638 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-65760bf7-35f3-4d7c-80ff-795a1464d376 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:29.639005 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-65760bf7-35f3-4d7c-80ff-795a1464d376 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:29.653810 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.quota [None req-452d9c72-dd3e-4dcc-93cd-e6e7a6990b2b tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Getting quotas for project 59fcbc120f0d4dc48dc0b3f2e7433b1a. Resources: {'cores', 'ram', 'instances'} {{(pid=117866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 10:09:29.658161 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.quota [None req-452d9c72-dd3e-4dcc-93cd-e6e7a6990b2b tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Getting quotas for user 348d6a68d7c84200899be9e72aeaded6 and project 59fcbc120f0d4dc48dc0b3f2e7433b1a. Resources: {'cores', 'ram', 'instances'} {{(pid=117866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 10:09:29.670527 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-452d9c72-dd3e-4dcc-93cd-e6e7a6990b2b tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Going to run 1 instances... {{(pid=117866) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 10:09:29.672840 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-452d9c72-dd3e-4dcc-93cd-e6e7a6990b2b tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: fd010082-5151-49dd-8919-7c004187d9b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80bd29b0-b77c-4611-be31-69ca559a2d2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 10:09:29.719059 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-65760bf7-35f3-4d7c-80ff-795a1464d376 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.092653 Jul 04 10:09:29.720226 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 58/118] 10.222.0.79 () {60 vars in 1315 bytes} [Mon Jul 4 10:09:29 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 10:09:29.722551 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-452d9c72-dd3e-4dcc-93cd-e6e7a6990b2b tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.992743 Jul 04 10:09:29.723501 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 61/119] 10.222.0.79 () {60 vars in 1146 bytes} [Mon Jul 4 10:09:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 04 10:09:29.733874 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2e8e24c9-9d90-41e3-b9b8-5bccd2fabba0 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:29.734600 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-2e8e24c9-9d90-41e3-b9b8-5bccd2fabba0 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: fd010082-5151-49dd-8919-7c004187d9b1] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:29.792884 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-d20aba66-0e58-4537-983c-3a4d6955adc5 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:29.793697 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-d20aba66-0e58-4537-983c-3a4d6955adc5 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:29.802474 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d20aba66-0e58-4537-983c-3a4d6955adc5 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:29.803014 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d20aba66-0e58-4537-983c-3a4d6955adc5 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:29.803888 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d20aba66-0e58-4537-983c-3a4d6955adc5 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:29.804406 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d20aba66-0e58-4537-983c-3a4d6955adc5 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:29.827269 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:29.841098 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-2e8e24c9-9d90-41e3-b9b8-5bccd2fabba0 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:29.848237 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-2e8e24c9-9d90-41e3-b9b8-5bccd2fabba0 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1" status: 200 len: 1214 microversion: 2.1 time: 0.118376 Jul 04 10:09:29.848812 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 59/120] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:29 2022] GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1 => generated 1214 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:30.140635 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-d20aba66-0e58-4537-983c-3a4d6955adc5 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:30.148762 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-d20aba66-0e58-4537-983c-3a4d6955adc5 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d" status: 200 len: 1556 microversion: 2.1 time: 0.361130 Jul 04 10:09:30.149434 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 62/121] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:29 2022] GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d => generated 1556 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:30.165887 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-fc981d49-0123-4ee7-9c82-39729e46d138 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:30.166374 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-fc981d49-0123-4ee7-9c82-39729e46d138 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:30.172588 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fc981d49-0123-4ee7-9c82-39729e46d138 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:30.173028 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fc981d49-0123-4ee7-9c82-39729e46d138 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:30.174077 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fc981d49-0123-4ee7-9c82-39729e46d138 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:30.174506 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fc981d49-0123-4ee7-9c82-39729e46d138 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:30.372405 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-751110c7-0702-49af-82a8-c81fe1f41d0f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:30.373482 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-751110c7-0702-49af-82a8-c81fe1f41d0f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:30.377502 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-fc981d49-0123-4ee7-9c82-39729e46d138 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.215409 Jul 04 10:09:30.384448 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 60/122] 10.222.0.79 () {58 vars in 1274 bytes} [Mon Jul 4 10:09:30 2022] GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d/os-interface => generated 284 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:09:30.384611 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-751110c7-0702-49af-82a8-c81fe1f41d0f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:30.384611 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-751110c7-0702-49af-82a8-c81fe1f41d0f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:30.384611 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-751110c7-0702-49af-82a8-c81fe1f41d0f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:30.384611 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-751110c7-0702-49af-82a8-c81fe1f41d0f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:30.866017 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-bf562f98-7043-4a24-a7f9-9bd3bdee38bf tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:30.866640 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-bf562f98-7043-4a24-a7f9-9bd3bdee38bf tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: fd010082-5151-49dd-8919-7c004187d9b1] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:30.869742 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:30.873516 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bf562f98-7043-4a24-a7f9-9bd3bdee38bf tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:30.873992 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bf562f98-7043-4a24-a7f9-9bd3bdee38bf tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:30.874767 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bf562f98-7043-4a24-a7f9-9bd3bdee38bf tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:30.875193 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bf562f98-7043-4a24-a7f9-9bd3bdee38bf tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:30.972350 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-bf562f98-7043-4a24-a7f9-9bd3bdee38bf tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:30.980424 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-bf562f98-7043-4a24-a7f9-9bd3bdee38bf tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1" status: 200 len: 1218 microversion: 2.1 time: 0.119140 Jul 04 10:09:30.980989 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 61/123] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:30 2022] GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1 => generated 1218 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:31.107782 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-751110c7-0702-49af-82a8-c81fe1f41d0f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:31.116645 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-751110c7-0702-49af-82a8-c81fe1f41d0f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.748139 Jul 04 10:09:31.117118 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 63/124] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:30 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:31.880984 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-9565e6d1-34f1-4635-a61d-932a51fcece7 req-b7fec08e-8fcb-4cb4-851d-6cbf38558968 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2", "tag": "ca00e905-cd23-4f89-b9a3-2e4d9b7e6b31"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:09:31.890367 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-9565e6d1-34f1-4635-a61d-932a51fcece7 req-b7fec08e-8fcb-4cb4-851d-6cbf38558968 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:31.890519 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-9565e6d1-34f1-4635-a61d-932a51fcece7 req-b7fec08e-8fcb-4cb4-851d-6cbf38558968 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:31.894580 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:31.903818 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-9565e6d1-34f1-4635-a61d-932a51fcece7 req-b7fec08e-8fcb-4cb4-851d-6cbf38558968 service nova] Creating event network-changed:ca00e905-cd23-4f89-b9a3-2e4d9b7e6b31 for instance ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 on hv-cinder-84841 Jul 04 10:09:31.909563 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-9565e6d1-34f1-4635-a61d-932a51fcece7 req-b7fec08e-8fcb-4cb4-851d-6cbf38558968 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032946 Jul 04 10:09:31.910174 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 62/125] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:09:31.998344 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-1af34f7c-ab30-42da-8bee-6796ff0cf106 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:31.998946 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-1af34f7c-ab30-42da-8bee-6796ff0cf106 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: fd010082-5151-49dd-8919-7c004187d9b1] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:32.005521 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1af34f7c-ab30-42da-8bee-6796ff0cf106 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:32.005970 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1af34f7c-ab30-42da-8bee-6796ff0cf106 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:32.006720 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1af34f7c-ab30-42da-8bee-6796ff0cf106 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:32.007143 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1af34f7c-ab30-42da-8bee-6796ff0cf106 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:32.072007 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-1af34f7c-ab30-42da-8bee-6796ff0cf106 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:32.079943 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-1af34f7c-ab30-42da-8bee-6796ff0cf106 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1" status: 200 len: 1218 microversion: 2.1 time: 0.085786 Jul 04 10:09:32.080521 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 64/126] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:31 2022] GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:32.134836 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-c528c414-da1e-4c01-82fe-f5484fc577e9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:32.135531 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-c528c414-da1e-4c01-82fe-f5484fc577e9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:32.148375 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c528c414-da1e-4c01-82fe-f5484fc577e9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:32.148825 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c528c414-da1e-4c01-82fe-f5484fc577e9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:32.149643 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c528c414-da1e-4c01-82fe-f5484fc577e9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:32.150084 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c528c414-da1e-4c01-82fe-f5484fc577e9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:32.285070 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-c528c414-da1e-4c01-82fe-f5484fc577e9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:32.293217 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-c528c414-da1e-4c01-82fe-f5484fc577e9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.162862 Jul 04 10:09:32.293839 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 63/127] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:32 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:33.097145 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-56112afb-9004-43aa-82eb-2474e3e56bbe tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:33.099064 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-56112afb-9004-43aa-82eb-2474e3e56bbe tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: fd010082-5151-49dd-8919-7c004187d9b1] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:33.105500 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-56112afb-9004-43aa-82eb-2474e3e56bbe tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:33.106003 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-56112afb-9004-43aa-82eb-2474e3e56bbe tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:33.106773 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-56112afb-9004-43aa-82eb-2474e3e56bbe tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:33.107200 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-56112afb-9004-43aa-82eb-2474e3e56bbe tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:33.176335 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-56112afb-9004-43aa-82eb-2474e3e56bbe tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:33.184500 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-56112afb-9004-43aa-82eb-2474e3e56bbe tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1" status: 200 len: 1218 microversion: 2.1 time: 0.091726 Jul 04 10:09:33.185127 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 65/128] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:33 2022] GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:33.310271 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-7f9fe884-fa99-47bd-8a38-c179acc722b9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:33.311606 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-7f9fe884-fa99-47bd-8a38-c179acc722b9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:33.322691 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7f9fe884-fa99-47bd-8a38-c179acc722b9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:33.323505 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7f9fe884-fa99-47bd-8a38-c179acc722b9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:33.325844 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7f9fe884-fa99-47bd-8a38-c179acc722b9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:33.338088 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7f9fe884-fa99-47bd-8a38-c179acc722b9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:33.840235 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-7f9fe884-fa99-47bd-8a38-c179acc722b9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:33.848273 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-7f9fe884-fa99-47bd-8a38-c179acc722b9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.542599 Jul 04 10:09:33.848874 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 64/129] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:33 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:33.925437 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-12194da1-4946-47f4-9f0c-41ecbcd4fdc0 req-68d5afb0-2ca0-4360-9859-039b61e43ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9659bd27-cdfe-44b1-9ffe-bec5319c9b5d", "tag": "5a1d4ccd-d32e-4fbf-9325-25b20937bbb8"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:09:33.934042 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-12194da1-4946-47f4-9f0c-41ecbcd4fdc0 req-68d5afb0-2ca0-4360-9859-039b61e43ba3 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:33.934476 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-12194da1-4946-47f4-9f0c-41ecbcd4fdc0 req-68d5afb0-2ca0-4360-9859-039b61e43ba3 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:33.946521 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-12194da1-4946-47f4-9f0c-41ecbcd4fdc0 req-68d5afb0-2ca0-4360-9859-039b61e43ba3 service nova] Creating event network-changed:5a1d4ccd-d32e-4fbf-9325-25b20937bbb8 for instance 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d on hv-cinder-84841 Jul 04 10:09:33.952721 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-12194da1-4946-47f4-9f0c-41ecbcd4fdc0 req-68d5afb0-2ca0-4360-9859-039b61e43ba3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031134 Jul 04 10:09:33.953388 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 66/130] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:09:34.201590 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-73459e57-eaea-49d4-80fc-d7a22ba9c1e9 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:34.202470 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-73459e57-eaea-49d4-80fc-d7a22ba9c1e9 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: fd010082-5151-49dd-8919-7c004187d9b1] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:34.214932 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-73459e57-eaea-49d4-80fc-d7a22ba9c1e9 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:34.218528 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-73459e57-eaea-49d4-80fc-d7a22ba9c1e9 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:34.219890 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-73459e57-eaea-49d4-80fc-d7a22ba9c1e9 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:34.220489 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-73459e57-eaea-49d4-80fc-d7a22ba9c1e9 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:34.396739 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-73459e57-eaea-49d4-80fc-d7a22ba9c1e9 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:34.409724 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-73459e57-eaea-49d4-80fc-d7a22ba9c1e9 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1" status: 200 len: 1274 microversion: 2.1 time: 0.212139 Jul 04 10:09:34.412282 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 65/131] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:34 2022] GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1 => generated 1274 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:34.866563 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-636a987c-cc0a-45da-a236-39dc924f17fd tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:34.867329 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-636a987c-cc0a-45da-a236-39dc924f17fd tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:34.877409 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-636a987c-cc0a-45da-a236-39dc924f17fd tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:34.879232 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-636a987c-cc0a-45da-a236-39dc924f17fd tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:34.880350 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-636a987c-cc0a-45da-a236-39dc924f17fd tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:34.880797 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-636a987c-cc0a-45da-a236-39dc924f17fd tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:35.336431 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-636a987c-cc0a-45da-a236-39dc924f17fd tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:35.349680 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-636a987c-cc0a-45da-a236-39dc924f17fd tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.487189 Jul 04 10:09:35.350368 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 67/132] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:34 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:35.429527 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-bf8813f6-17d3-4bcc-ab9b-3dd5343c016b tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:35.429527 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-bf8813f6-17d3-4bcc-ab9b-3dd5343c016b tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: fd010082-5151-49dd-8919-7c004187d9b1] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:35.442854 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bf8813f6-17d3-4bcc-ab9b-3dd5343c016b tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:35.443931 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bf8813f6-17d3-4bcc-ab9b-3dd5343c016b tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:35.445447 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bf8813f6-17d3-4bcc-ab9b-3dd5343c016b tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:35.447738 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bf8813f6-17d3-4bcc-ab9b-3dd5343c016b tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:35.668230 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-bf8813f6-17d3-4bcc-ab9b-3dd5343c016b tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:35.676353 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-bf8813f6-17d3-4bcc-ab9b-3dd5343c016b tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1" status: 200 len: 1314 microversion: 2.1 time: 0.251974 Jul 04 10:09:35.676923 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 66/133] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:35 2022] GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:36.368580 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-01caabcf-d6e5-424c-8757-13864f701d2f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:36.369976 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-01caabcf-d6e5-424c-8757-13864f701d2f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:36.378532 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-01caabcf-d6e5-424c-8757-13864f701d2f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:36.379583 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-01caabcf-d6e5-424c-8757-13864f701d2f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:36.380787 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-01caabcf-d6e5-424c-8757-13864f701d2f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:36.381440 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-01caabcf-d6e5-424c-8757-13864f701d2f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:36.606226 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-01caabcf-d6e5-424c-8757-13864f701d2f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:36.614188 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-01caabcf-d6e5-424c-8757-13864f701d2f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.249915 Jul 04 10:09:36.614764 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 68/134] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:36 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:36.651621 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-2e306d51-dbf0-4993-b430-dcf032856e4c req-d87e9ce1-79f3-40a8-a929-e05ad3ff1a18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd010082-5151-49dd-8919-7c004187d9b1", "tag": "81bf9e52-9e4d-40a9-9082-fc9577c5149c"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:09:36.660811 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-2e306d51-dbf0-4993-b430-dcf032856e4c req-d87e9ce1-79f3-40a8-a929-e05ad3ff1a18 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:36.661259 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-2e306d51-dbf0-4993-b430-dcf032856e4c req-d87e9ce1-79f3-40a8-a929-e05ad3ff1a18 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:36.672905 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-2e306d51-dbf0-4993-b430-dcf032856e4c req-d87e9ce1-79f3-40a8-a929-e05ad3ff1a18 service nova] Creating event network-changed:81bf9e52-9e4d-40a9-9082-fc9577c5149c for instance fd010082-5151-49dd-8919-7c004187d9b1 on hv-cinder-84841 Jul 04 10:09:36.678336 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-2e306d51-dbf0-4993-b430-dcf032856e4c req-d87e9ce1-79f3-40a8-a929-e05ad3ff1a18 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033124 Jul 04 10:09:36.678944 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 67/135] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:09:36.693692 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-ba00c304-6cfe-4d7a-9ff9-dd01ad69dc10 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:36.694299 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-ba00c304-6cfe-4d7a-9ff9-dd01ad69dc10 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: fd010082-5151-49dd-8919-7c004187d9b1] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:36.700339 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ba00c304-6cfe-4d7a-9ff9-dd01ad69dc10 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:36.700773 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ba00c304-6cfe-4d7a-9ff9-dd01ad69dc10 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:36.701530 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ba00c304-6cfe-4d7a-9ff9-dd01ad69dc10 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:36.701983 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ba00c304-6cfe-4d7a-9ff9-dd01ad69dc10 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:36.834988 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-ba00c304-6cfe-4d7a-9ff9-dd01ad69dc10 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:36.842690 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-ba00c304-6cfe-4d7a-9ff9-dd01ad69dc10 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1" status: 200 len: 1314 microversion: 2.1 time: 0.153022 Jul 04 10:09:36.843310 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 69/136] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:36 2022] GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:37.633129 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-319a9583-68a3-42dd-b1cc-6270c38ac5b5 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:37.633831 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-319a9583-68a3-42dd-b1cc-6270c38ac5b5 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:37.640306 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-319a9583-68a3-42dd-b1cc-6270c38ac5b5 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:37.640746 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-319a9583-68a3-42dd-b1cc-6270c38ac5b5 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:37.641499 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-319a9583-68a3-42dd-b1cc-6270c38ac5b5 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:37.641957 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-319a9583-68a3-42dd-b1cc-6270c38ac5b5 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:37.776476 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-319a9583-68a3-42dd-b1cc-6270c38ac5b5 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:37.784493 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-319a9583-68a3-42dd-b1cc-6270c38ac5b5 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.155786 Jul 04 10:09:37.785066 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 68/137] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:37 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:37.864300 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-97c87fb2-b5cc-4c2c-95a2-a505641dc63e tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:37.865889 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-97c87fb2-b5cc-4c2c-95a2-a505641dc63e tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: fd010082-5151-49dd-8919-7c004187d9b1] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:37.876216 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-97c87fb2-b5cc-4c2c-95a2-a505641dc63e tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:37.876949 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-97c87fb2-b5cc-4c2c-95a2-a505641dc63e tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:37.878264 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-97c87fb2-b5cc-4c2c-95a2-a505641dc63e tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:37.878994 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-97c87fb2-b5cc-4c2c-95a2-a505641dc63e tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:38.013708 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-97c87fb2-b5cc-4c2c-95a2-a505641dc63e tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:38.024200 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-97c87fb2-b5cc-4c2c-95a2-a505641dc63e tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1" status: 200 len: 1314 microversion: 2.1 time: 0.166385 Jul 04 10:09:38.024712 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 70/138] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:37 2022] GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:38.804494 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-a22d0d07-579f-4bb7-83e9-7244688ca74f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:38.805103 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-a22d0d07-579f-4bb7-83e9-7244688ca74f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:38.812199 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a22d0d07-579f-4bb7-83e9-7244688ca74f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:38.812641 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a22d0d07-579f-4bb7-83e9-7244688ca74f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:38.813400 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a22d0d07-579f-4bb7-83e9-7244688ca74f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:38.813996 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a22d0d07-579f-4bb7-83e9-7244688ca74f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:39.040857 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-13addac2-e79c-4ce4-8306-5df81a1c3639 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:39.041444 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-13addac2-e79c-4ce4-8306-5df81a1c3639 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: fd010082-5151-49dd-8919-7c004187d9b1] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:39.047890 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-13addac2-e79c-4ce4-8306-5df81a1c3639 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:39.048336 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-13addac2-e79c-4ce4-8306-5df81a1c3639 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:39.049104 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-13addac2-e79c-4ce4-8306-5df81a1c3639 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:39.049540 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-13addac2-e79c-4ce4-8306-5df81a1c3639 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:39.203050 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-a22d0d07-579f-4bb7-83e9-7244688ca74f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:39.211058 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-a22d0d07-579f-4bb7-83e9-7244688ca74f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.412458 Jul 04 10:09:39.212044 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 69/139] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:38 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:39.247221 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-13addac2-e79c-4ce4-8306-5df81a1c3639 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:39.254810 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-13addac2-e79c-4ce4-8306-5df81a1c3639 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1" status: 200 len: 1314 microversion: 2.1 time: 0.218143 Jul 04 10:09:39.255352 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 71/140] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:39 2022] GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:40.228633 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5242f2a7-0c49-4f3b-b78c-2659387836b6 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:40.229224 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-5242f2a7-0c49-4f3b-b78c-2659387836b6 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:40.231719 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:40.237556 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5242f2a7-0c49-4f3b-b78c-2659387836b6 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:40.238035 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5242f2a7-0c49-4f3b-b78c-2659387836b6 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:40.238802 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5242f2a7-0c49-4f3b-b78c-2659387836b6 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:40.239213 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5242f2a7-0c49-4f3b-b78c-2659387836b6 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:40.271983 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-ead22826-2527-4d56-ba0b-441ea790b6fa tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:40.272922 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-ead22826-2527-4d56-ba0b-441ea790b6fa tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: fd010082-5151-49dd-8919-7c004187d9b1] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:40.275100 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell0:SELECT=2 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:40.275732 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell0:SELECT=6 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:40.276425 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:40.282808 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ead22826-2527-4d56-ba0b-441ea790b6fa tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:40.283186 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ead22826-2527-4d56-ba0b-441ea790b6fa tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:40.283957 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ead22826-2527-4d56-ba0b-441ea790b6fa tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:40.284392 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ead22826-2527-4d56-ba0b-441ea790b6fa tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:40.420467 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-5242f2a7-0c49-4f3b-b78c-2659387836b6 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:40.428318 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-5242f2a7-0c49-4f3b-b78c-2659387836b6 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.203574 Jul 04 10:09:40.428973 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 70/141] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:40 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:40.454252 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-ead22826-2527-4d56-ba0b-441ea790b6fa tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:40.461853 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-ead22826-2527-4d56-ba0b-441ea790b6fa tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1" status: 200 len: 1314 microversion: 2.1 time: 0.193725 Jul 04 10:09:40.462411 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 72/142] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:40 2022] GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:41.446353 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-a40eb590-a9b1-4e30-8d4a-8e8d893b2e39 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:41.446902 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-a40eb590-a9b1-4e30-8d4a-8e8d893b2e39 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:41.453778 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a40eb590-a9b1-4e30-8d4a-8e8d893b2e39 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:41.454221 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a40eb590-a9b1-4e30-8d4a-8e8d893b2e39 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:41.454975 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a40eb590-a9b1-4e30-8d4a-8e8d893b2e39 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:41.455403 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a40eb590-a9b1-4e30-8d4a-8e8d893b2e39 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:41.479337 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-8e2a6e88-25a7-4dc9-84eb-b861049e73e2 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:41.479965 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-8e2a6e88-25a7-4dc9-84eb-b861049e73e2 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: fd010082-5151-49dd-8919-7c004187d9b1] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:41.486653 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8e2a6e88-25a7-4dc9-84eb-b861049e73e2 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:41.487090 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8e2a6e88-25a7-4dc9-84eb-b861049e73e2 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:41.487839 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8e2a6e88-25a7-4dc9-84eb-b861049e73e2 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:41.488261 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8e2a6e88-25a7-4dc9-84eb-b861049e73e2 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:41.658874 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-a40eb590-a9b1-4e30-8d4a-8e8d893b2e39 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:41.662290 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-8e2a6e88-25a7-4dc9-84eb-b861049e73e2 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:41.666961 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-a40eb590-a9b1-4e30-8d4a-8e8d893b2e39 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.224926 Jul 04 10:09:41.667776 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 71/143] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:41 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:41.670429 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-8e2a6e88-25a7-4dc9-84eb-b861049e73e2 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1" status: 200 len: 1314 microversion: 2.1 time: 0.195082 Jul 04 10:09:41.671232 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 73/144] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:41 2022] GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:42.685514 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-6bd4455a-5d3b-4cb9-a7ce-16b120ee0557 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:42.686206 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-6bd4455a-5d3b-4cb9-a7ce-16b120ee0557 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:42.688225 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-dcce16f7-5240-4d49-b3ce-45713638c891 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:42.688800 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-dcce16f7-5240-4d49-b3ce-45713638c891 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: fd010082-5151-49dd-8919-7c004187d9b1] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:42.693043 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6bd4455a-5d3b-4cb9-a7ce-16b120ee0557 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:42.693483 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6bd4455a-5d3b-4cb9-a7ce-16b120ee0557 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:42.694451 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6bd4455a-5d3b-4cb9-a7ce-16b120ee0557 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:42.694877 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6bd4455a-5d3b-4cb9-a7ce-16b120ee0557 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:42.695071 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-dcce16f7-5240-4d49-b3ce-45713638c891 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:42.695490 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-dcce16f7-5240-4d49-b3ce-45713638c891 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:42.696253 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-dcce16f7-5240-4d49-b3ce-45713638c891 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:42.696673 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-dcce16f7-5240-4d49-b3ce-45713638c891 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:42.895127 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-6bd4455a-5d3b-4cb9-a7ce-16b120ee0557 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:42.898574 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-dcce16f7-5240-4d49-b3ce-45713638c891 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:42.903170 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-6bd4455a-5d3b-4cb9-a7ce-16b120ee0557 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.221594 Jul 04 10:09:42.903879 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 72/145] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:42 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:42.906319 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-dcce16f7-5240-4d49-b3ce-45713638c891 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1" status: 200 len: 1314 microversion: 2.1 time: 0.221933 Jul 04 10:09:42.906893 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 74/146] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:42 2022] GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:43.920488 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8b08f746-cf92-429f-bf24-54774c40bad2 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:43.921035 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-8b08f746-cf92-429f-bf24-54774c40bad2 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:43.924123 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-6528bd81-ea3c-46b1-80e3-33a20efd241f tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:43.924702 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-6528bd81-ea3c-46b1-80e3-33a20efd241f tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: fd010082-5151-49dd-8919-7c004187d9b1] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:43.928086 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8b08f746-cf92-429f-bf24-54774c40bad2 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:43.928619 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8b08f746-cf92-429f-bf24-54774c40bad2 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:43.929459 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8b08f746-cf92-429f-bf24-54774c40bad2 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:43.929991 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8b08f746-cf92-429f-bf24-54774c40bad2 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:43.930830 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-6528bd81-ea3c-46b1-80e3-33a20efd241f tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:43.931277 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-6528bd81-ea3c-46b1-80e3-33a20efd241f tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:43.932050 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-6528bd81-ea3c-46b1-80e3-33a20efd241f tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:43.932501 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-6528bd81-ea3c-46b1-80e3-33a20efd241f tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:44.128519 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-8b08f746-cf92-429f-bf24-54774c40bad2 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:44.134075 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-6528bd81-ea3c-46b1-80e3-33a20efd241f tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:44.139278 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-8b08f746-cf92-429f-bf24-54774c40bad2 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.222158 Jul 04 10:09:44.139521 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 73/147] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:43 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:44.152614 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-6528bd81-ea3c-46b1-80e3-33a20efd241f tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1" status: 200 len: 1314 microversion: 2.1 time: 0.232219 Jul 04 10:09:44.153207 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 75/148] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:43 2022] GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:09:45.156547 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-a6b8f24c-9066-4542-9f2e-3ab94240d71a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:45.157131 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-a6b8f24c-9066-4542-9f2e-3ab94240d71a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:45.164127 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a6b8f24c-9066-4542-9f2e-3ab94240d71a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:45.164567 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a6b8f24c-9066-4542-9f2e-3ab94240d71a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:45.165774 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a6b8f24c-9066-4542-9f2e-3ab94240d71a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:45.166200 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a6b8f24c-9066-4542-9f2e-3ab94240d71a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:45.169821 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-1abb04b5-534b-4e09-8c21-e4258305b1f1 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:45.170434 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-1abb04b5-534b-4e09-8c21-e4258305b1f1 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: fd010082-5151-49dd-8919-7c004187d9b1] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:45.176836 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1abb04b5-534b-4e09-8c21-e4258305b1f1 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:45.177282 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1abb04b5-534b-4e09-8c21-e4258305b1f1 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:45.178084 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1abb04b5-534b-4e09-8c21-e4258305b1f1 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:45.178520 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1abb04b5-534b-4e09-8c21-e4258305b1f1 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:45.375460 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-a6b8f24c-9066-4542-9f2e-3ab94240d71a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:45.380753 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-1abb04b5-534b-4e09-8c21-e4258305b1f1 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:45.388344 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-a6b8f24c-9066-4542-9f2e-3ab94240d71a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.235635 Jul 04 10:09:45.389171 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 74/149] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:45 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:45.397804 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-1abb04b5-534b-4e09-8c21-e4258305b1f1 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1" status: 200 len: 1314 microversion: 2.1 time: 0.224100 Jul 04 10:09:45.397804 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 76/150] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:45 2022] GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:46.407580 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-bb5ca859-aef3-4915-ba56-09a12ed3efbd tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:46.409313 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-bb5ca859-aef3-4915-ba56-09a12ed3efbd tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: fd010082-5151-49dd-8919-7c004187d9b1] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:46.414301 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-cc3dc455-ecc8-4ba3-a307-7958a0b3d7f1 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:46.416928 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-bb5ca859-aef3-4915-ba56-09a12ed3efbd tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:46.417654 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-bb5ca859-aef3-4915-ba56-09a12ed3efbd tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:46.418970 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-bb5ca859-aef3-4915-ba56-09a12ed3efbd tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:46.419477 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-bb5ca859-aef3-4915-ba56-09a12ed3efbd tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:46.420645 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-cc3dc455-ecc8-4ba3-a307-7958a0b3d7f1 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:46.436289 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cc3dc455-ecc8-4ba3-a307-7958a0b3d7f1 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:46.436956 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cc3dc455-ecc8-4ba3-a307-7958a0b3d7f1 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:46.443355 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cc3dc455-ecc8-4ba3-a307-7958a0b3d7f1 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:46.444169 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cc3dc455-ecc8-4ba3-a307-7958a0b3d7f1 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:46.635907 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-bb5ca859-aef3-4915-ba56-09a12ed3efbd tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:46.645716 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-bb5ca859-aef3-4915-ba56-09a12ed3efbd tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1" status: 200 len: 1314 microversion: 2.1 time: 0.241939 Jul 04 10:09:46.647341 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 77/151] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:46 2022] GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:46.736097 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-cc3dc455-ecc8-4ba3-a307-7958a0b3d7f1 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:46.747860 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-cc3dc455-ecc8-4ba3-a307-7958a0b3d7f1 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.337166 Jul 04 10:09:46.753708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 75/152] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:46 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:47.309765 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-9871de5a-efd9-419c-95ca-cd70e309aebd req-2b881577-23a3-4a65-bb3a-792498259227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd010082-5151-49dd-8919-7c004187d9b1", "name": "network-vif-plugged", "status": "completed", "tag": "81bf9e52-9e4d-40a9-9082-fc9577c5149c"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:09:47.318462 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-9871de5a-efd9-419c-95ca-cd70e309aebd req-2b881577-23a3-4a65-bb3a-792498259227 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:47.319124 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-9871de5a-efd9-419c-95ca-cd70e309aebd req-2b881577-23a3-4a65-bb3a-792498259227 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:47.331574 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-9871de5a-efd9-419c-95ca-cd70e309aebd req-2b881577-23a3-4a65-bb3a-792498259227 service nova] Creating event network-vif-plugged:81bf9e52-9e4d-40a9-9082-fc9577c5149c for instance fd010082-5151-49dd-8919-7c004187d9b1 on hv-cinder-84841 Jul 04 10:09:47.336695 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-9871de5a-efd9-419c-95ca-cd70e309aebd req-2b881577-23a3-4a65-bb3a-792498259227 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031372 Jul 04 10:09:47.337473 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 78/153] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:09:47.574826 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-91a596d7-e599-42ac-95cc-65edc7f1de38 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:47.575407 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-91a596d7-e599-42ac-95cc-65edc7f1de38 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] [instance: e8df803a-688f-4388-836b-8a16ccc26eba] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:47.583373 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-91a596d7-e599-42ac-95cc-65edc7f1de38 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:47.583848 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-91a596d7-e599-42ac-95cc-65edc7f1de38 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:47.584907 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-91a596d7-e599-42ac-95cc-65edc7f1de38 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:47.585744 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-91a596d7-e599-42ac-95cc-65edc7f1de38 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:47.612090 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-91a596d7-e599-42ac-95cc-65edc7f1de38 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] [instance: e8df803a-688f-4388-836b-8a16ccc26eba] Going to try to terminate instance {{(pid=117865) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 10:09:47.664530 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-980744c8-d071-4b3f-b1ed-f4d80a14a9e0 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:47.665828 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-980744c8-d071-4b3f-b1ed-f4d80a14a9e0 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: fd010082-5151-49dd-8919-7c004187d9b1] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:47.672375 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-980744c8-d071-4b3f-b1ed-f4d80a14a9e0 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:47.672843 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-980744c8-d071-4b3f-b1ed-f4d80a14a9e0 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:47.673674 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-980744c8-d071-4b3f-b1ed-f4d80a14a9e0 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:47.674110 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-980744c8-d071-4b3f-b1ed-f4d80a14a9e0 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:47.713592 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-91a596d7-e599-42ac-95cc-65edc7f1de38 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba" status: 204 len: 0 microversion: 2.1 time: 0.142123 Jul 04 10:09:47.714536 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 76/154] 10.222.0.79 () {58 vars in 1238 bytes} [Mon Jul 4 10:09:47 2022] DELETE /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 10:09:47.723124 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-3db94700-f963-4ff3-8964-51a45618304e tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:47.723805 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-3db94700-f963-4ff3-8964-51a45618304e tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] [instance: e8df803a-688f-4388-836b-8a16ccc26eba] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:47.730472 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3db94700-f963-4ff3-8964-51a45618304e tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:47.730921 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3db94700-f963-4ff3-8964-51a45618304e tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:47.731684 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3db94700-f963-4ff3-8964-51a45618304e tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:47.732117 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3db94700-f963-4ff3-8964-51a45618304e tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:47.866566 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-980744c8-d071-4b3f-b1ed-f4d80a14a9e0 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:47.874640 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-980744c8-d071-4b3f-b1ed-f4d80a14a9e0 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1" status: 200 len: 1314 microversion: 2.1 time: 0.214253 Jul 04 10:09:47.875230 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 79/155] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:47 2022] GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:47.879763 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-972018bd-5d3e-4f4b-ab46-76a0def9df44 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:47.880355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-972018bd-5d3e-4f4b-ab46-76a0def9df44 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:47.887499 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-972018bd-5d3e-4f4b-ab46-76a0def9df44 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:47.888010 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-972018bd-5d3e-4f4b-ab46-76a0def9df44 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:47.888792 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-972018bd-5d3e-4f4b-ab46-76a0def9df44 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:47.889374 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-972018bd-5d3e-4f4b-ab46-76a0def9df44 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:47.910610 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-3db94700-f963-4ff3-8964-51a45618304e tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64835c93d17543668a8039caeeaa393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f718c1e8ae45dbb633172c0ba74c5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:47.911164 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell1:SELECT=100 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:47.920789 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-3db94700-f963-4ff3-8964-51a45618304e tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] 10.222.0.79 "GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba" status: 200 len: 1554 microversion: 2.1 time: 0.201943 Jul 04 10:09:47.921380 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 77/156] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:47 2022] GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba => generated 1554 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:09:48.033264 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-972018bd-5d3e-4f4b-ab46-76a0def9df44 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:48.041254 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-972018bd-5d3e-4f4b-ab46-76a0def9df44 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.164923 Jul 04 10:09:48.041962 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 80/157] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:47 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:48.892176 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-62015fe8-0845-46ec-bab3-fa20aa426367 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:48.893054 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-62015fe8-0845-46ec-bab3-fa20aa426367 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: fd010082-5151-49dd-8919-7c004187d9b1] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:48.899829 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-62015fe8-0845-46ec-bab3-fa20aa426367 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:48.900293 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-62015fe8-0845-46ec-bab3-fa20aa426367 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:48.901046 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-62015fe8-0845-46ec-bab3-fa20aa426367 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:48.901470 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-62015fe8-0845-46ec-bab3-fa20aa426367 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:48.917326 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:48.939366 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-7f11efe2-8e27-4096-b0fc-12f2c22d9f84 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:48.940004 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-7f11efe2-8e27-4096-b0fc-12f2c22d9f84 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] [instance: e8df803a-688f-4388-836b-8a16ccc26eba] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:48.946532 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7f11efe2-8e27-4096-b0fc-12f2c22d9f84 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:48.947191 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7f11efe2-8e27-4096-b0fc-12f2c22d9f84 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:48.947953 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7f11efe2-8e27-4096-b0fc-12f2c22d9f84 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:48.948358 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7f11efe2-8e27-4096-b0fc-12f2c22d9f84 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:49.093454 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-62015fe8-0845-46ec-bab3-fa20aa426367 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:49.101845 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-62015fe8-0845-46ec-bab3-fa20aa426367 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1" status: 200 len: 1314 microversion: 2.1 time: 0.213850 Jul 04 10:09:49.102425 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 78/158] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:48 2022] GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:49.117341 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-66294dea-4719-4517-943f-67e352dc66e9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:49.117979 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-66294dea-4719-4517-943f-67e352dc66e9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:49.128516 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-7f11efe2-8e27-4096-b0fc-12f2c22d9f84 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64835c93d17543668a8039caeeaa393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f718c1e8ae45dbb633172c0ba74c5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:49.137945 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-66294dea-4719-4517-943f-67e352dc66e9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:49.138480 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-66294dea-4719-4517-943f-67e352dc66e9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:49.139420 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-66294dea-4719-4517-943f-67e352dc66e9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:49.139916 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-66294dea-4719-4517-943f-67e352dc66e9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:49.140098 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-7f11efe2-8e27-4096-b0fc-12f2c22d9f84 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] 10.222.0.79 "GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba" status: 200 len: 1554 microversion: 2.1 time: 0.204104 Jul 04 10:09:49.141270 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 81/159] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:48 2022] GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba => generated 1554 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:49.299385 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-66294dea-4719-4517-943f-67e352dc66e9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:49.308571 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-66294dea-4719-4517-943f-67e352dc66e9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.195209 Jul 04 10:09:49.309528 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 79/160] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:49 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:50.120223 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-e358e215-0f4f-4948-b335-a2ab5dd38c0b tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:50.120826 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-e358e215-0f4f-4948-b335-a2ab5dd38c0b tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: fd010082-5151-49dd-8919-7c004187d9b1] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:50.128010 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e358e215-0f4f-4948-b335-a2ab5dd38c0b tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:50.128447 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e358e215-0f4f-4948-b335-a2ab5dd38c0b tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:50.129213 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e358e215-0f4f-4948-b335-a2ab5dd38c0b tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:50.129642 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e358e215-0f4f-4948-b335-a2ab5dd38c0b tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:50.156640 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-98b26782-cd75-465d-91f6-9056dca3f88d tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:50.157240 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-98b26782-cd75-465d-91f6-9056dca3f88d tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] [instance: e8df803a-688f-4388-836b-8a16ccc26eba] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:50.163868 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-98b26782-cd75-465d-91f6-9056dca3f88d tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:50.164311 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-98b26782-cd75-465d-91f6-9056dca3f88d tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:50.165075 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-98b26782-cd75-465d-91f6-9056dca3f88d tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:50.165500 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-98b26782-cd75-465d-91f6-9056dca3f88d tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:50.349215 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-e358e215-0f4f-4948-b335-a2ab5dd38c0b tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:50.351436 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-98b26782-cd75-465d-91f6-9056dca3f88d tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64835c93d17543668a8039caeeaa393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f718c1e8ae45dbb633172c0ba74c5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:50.359122 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-e358e215-0f4f-4948-b335-a2ab5dd38c0b tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1" status: 200 len: 1314 microversion: 2.1 time: 0.242671 Jul 04 10:09:50.366450 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-98b26782-cd75-465d-91f6-9056dca3f88d tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] 10.222.0.79 "GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba" status: 200 len: 1554 microversion: 2.1 time: 0.213611 Jul 04 10:09:50.366602 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 82/161] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:50 2022] GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:50.367283 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 80/162] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:50 2022] GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba => generated 1554 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:50.379408 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-d77dc1fc-f2f3-439a-969f-869bf9d94ef3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:50.380035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-d77dc1fc-f2f3-439a-969f-869bf9d94ef3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:50.387631 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d77dc1fc-f2f3-439a-969f-869bf9d94ef3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:50.391242 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d77dc1fc-f2f3-439a-969f-869bf9d94ef3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:50.391242 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d77dc1fc-f2f3-439a-969f-869bf9d94ef3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:50.391242 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d77dc1fc-f2f3-439a-969f-869bf9d94ef3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:50.534888 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-d77dc1fc-f2f3-439a-969f-869bf9d94ef3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:50.543047 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-d77dc1fc-f2f3-439a-969f-869bf9d94ef3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.167399 Jul 04 10:09:50.543672 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 83/163] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:50 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:51.383284 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-be1070cc-2686-463b-b0f1-c70f900fe13a tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:51.383965 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-28fe1548-8c48-4f6e-8155-68cac51321a8 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:51.384318 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-be1070cc-2686-463b-b0f1-c70f900fe13a tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] [instance: e8df803a-688f-4388-836b-8a16ccc26eba] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:51.384406 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-28fe1548-8c48-4f6e-8155-68cac51321a8 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: fd010082-5151-49dd-8919-7c004187d9b1] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:51.390125 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-be1070cc-2686-463b-b0f1-c70f900fe13a tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:51.390570 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-be1070cc-2686-463b-b0f1-c70f900fe13a tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:51.391001 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-28fe1548-8c48-4f6e-8155-68cac51321a8 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:51.391325 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-be1070cc-2686-463b-b0f1-c70f900fe13a tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:51.391461 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-28fe1548-8c48-4f6e-8155-68cac51321a8 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:51.391747 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-be1070cc-2686-463b-b0f1-c70f900fe13a tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:51.392199 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-28fe1548-8c48-4f6e-8155-68cac51321a8 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:51.392630 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-28fe1548-8c48-4f6e-8155-68cac51321a8 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:51.597253 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-28fe1548-8c48-4f6e-8155-68cac51321a8 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:51.600530 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-be1070cc-2686-463b-b0f1-c70f900fe13a tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64835c93d17543668a8039caeeaa393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f718c1e8ae45dbb633172c0ba74c5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:51.605166 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-28fe1548-8c48-4f6e-8155-68cac51321a8 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1" status: 200 len: 1497 microversion: 2.1 time: 0.225841 Jul 04 10:09:51.605765 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 81/164] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:51 2022] GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1 => generated 1497 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:51.609762 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-be1070cc-2686-463b-b0f1-c70f900fe13a tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] 10.222.0.79 "GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba" status: 200 len: 1554 microversion: 2.1 time: 0.230376 Jul 04 10:09:51.610390 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-05786ed1-b139-4309-a6a3-f1e464623657 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:51.610858 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 84/165] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:51 2022] GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba => generated 1554 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:51.618622 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-05786ed1-b139-4309-a6a3-f1e464623657 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:51.625813 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-05786ed1-b139-4309-a6a3-f1e464623657 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:51.626226 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-05786ed1-b139-4309-a6a3-f1e464623657 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:51.627025 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-05786ed1-b139-4309-a6a3-f1e464623657 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:51.638351 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-05786ed1-b139-4309-a6a3-f1e464623657 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:51.783636 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-05786ed1-b139-4309-a6a3-f1e464623657 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:51.793831 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-05786ed1-b139-4309-a6a3-f1e464623657 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.186766 Jul 04 10:09:51.794435 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 82/166] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:51 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:52.184501 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-bbb0770b-7142-450f-b5a1-f75d9668fb4f tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:52.185256 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-bbb0770b-7142-450f-b5a1-f75d9668fb4f tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: fd010082-5151-49dd-8919-7c004187d9b1] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:52.192417 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-bbb0770b-7142-450f-b5a1-f75d9668fb4f tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:52.193326 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-bbb0770b-7142-450f-b5a1-f75d9668fb4f tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:52.194158 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-bbb0770b-7142-450f-b5a1-f75d9668fb4f tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:52.194584 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-bbb0770b-7142-450f-b5a1-f75d9668fb4f tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:52.221865 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-bbb0770b-7142-450f-b5a1-f75d9668fb4f tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: fd010082-5151-49dd-8919-7c004187d9b1] Going to try to terminate instance {{(pid=117866) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 10:09:52.369708 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-bbb0770b-7142-450f-b5a1-f75d9668fb4f tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "DELETE /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1" status: 204 len: 0 microversion: 2.1 time: 0.189469 Jul 04 10:09:52.372924 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 85/167] 10.222.0.79 () {58 vars in 1238 bytes} [Mon Jul 4 10:09:52 2022] DELETE /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 10:09:52.381595 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-3939df67-9bb8-459d-889c-bdef86db066d tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:52.382278 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-3939df67-9bb8-459d-889c-bdef86db066d tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: fd010082-5151-49dd-8919-7c004187d9b1] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:52.389936 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3939df67-9bb8-459d-889c-bdef86db066d tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:52.390756 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-e235923c-dd00-4215-b3a6-dbe48576037b req-cae8e593-ed9a-4ed0-a8a8-b1e1a68f116b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8df803a-688f-4388-836b-8a16ccc26eba", "name": "network-vif-deleted", "tag": "a30a62d5-35f1-42ed-b4ce-dbf70419be13"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:09:52.391671 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3939df67-9bb8-459d-889c-bdef86db066d tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:52.392597 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3939df67-9bb8-459d-889c-bdef86db066d tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:52.393020 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3939df67-9bb8-459d-889c-bdef86db066d tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:52.408869 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-e235923c-dd00-4215-b3a6-dbe48576037b req-cae8e593-ed9a-4ed0-a8a8-b1e1a68f116b service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:52.409301 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-e235923c-dd00-4215-b3a6-dbe48576037b req-cae8e593-ed9a-4ed0-a8a8-b1e1a68f116b service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:52.436872 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-e235923c-dd00-4215-b3a6-dbe48576037b req-cae8e593-ed9a-4ed0-a8a8-b1e1a68f116b service nova] Creating event network-vif-deleted:a30a62d5-35f1-42ed-b4ce-dbf70419be13 for instance e8df803a-688f-4388-836b-8a16ccc26eba on hv-cinder-84841 Jul 04 10:09:52.444943 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-e235923c-dd00-4215-b3a6-dbe48576037b req-cae8e593-ed9a-4ed0-a8a8-b1e1a68f116b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058997 Jul 04 10:09:52.448549 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 86/168] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:09:52.564798 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-3939df67-9bb8-459d-889c-bdef86db066d tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:52.574422 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-3939df67-9bb8-459d-889c-bdef86db066d tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1" status: 200 len: 1503 microversion: 2.1 time: 0.196853 Jul 04 10:09:52.575346 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 83/169] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:52 2022] GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1 => generated 1503 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:52.626674 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-75d3ee7a-8523-457c-a7e2-a6e33bfb05c1 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:52.627364 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-75d3ee7a-8523-457c-a7e2-a6e33bfb05c1 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] [instance: e8df803a-688f-4388-836b-8a16ccc26eba] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:52.634405 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-75d3ee7a-8523-457c-a7e2-a6e33bfb05c1 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:52.634853 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-75d3ee7a-8523-457c-a7e2-a6e33bfb05c1 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:52.635592 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-75d3ee7a-8523-457c-a7e2-a6e33bfb05c1 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:52.636017 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-75d3ee7a-8523-457c-a7e2-a6e33bfb05c1 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:52.701143 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-75d3ee7a-8523-457c-a7e2-a6e33bfb05c1 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64835c93d17543668a8039caeeaa393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f718c1e8ae45dbb633172c0ba74c5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:52.709680 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-75d3ee7a-8523-457c-a7e2-a6e33bfb05c1 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] 10.222.0.79 "GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba" status: 200 len: 1512 microversion: 2.1 time: 0.087225 Jul 04 10:09:52.710255 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 87/170] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:52 2022] GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba => generated 1512 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:52.811209 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-313b64c1-e12f-4ca6-b8bb-ccdc55cdbd4a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:52.811822 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-313b64c1-e12f-4ca6-b8bb-ccdc55cdbd4a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:52.818642 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-313b64c1-e12f-4ca6-b8bb-ccdc55cdbd4a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:52.819090 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-313b64c1-e12f-4ca6-b8bb-ccdc55cdbd4a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:52.819915 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-313b64c1-e12f-4ca6-b8bb-ccdc55cdbd4a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:52.820325 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-313b64c1-e12f-4ca6-b8bb-ccdc55cdbd4a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:52.964207 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-313b64c1-e12f-4ca6-b8bb-ccdc55cdbd4a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:52.977723 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-313b64c1-e12f-4ca6-b8bb-ccdc55cdbd4a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.170385 Jul 04 10:09:52.978367 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 84/171] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:52 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:53.596611 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-6b6cfdc8-b2cf-43f6-ac62-17fda24f7406 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:53.597304 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-6b6cfdc8-b2cf-43f6-ac62-17fda24f7406 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: fd010082-5151-49dd-8919-7c004187d9b1] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:53.604631 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-6b6cfdc8-b2cf-43f6-ac62-17fda24f7406 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:53.605231 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-6b6cfdc8-b2cf-43f6-ac62-17fda24f7406 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:53.606144 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-6b6cfdc8-b2cf-43f6-ac62-17fda24f7406 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:53.606638 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-6b6cfdc8-b2cf-43f6-ac62-17fda24f7406 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:53.729653 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-4e83d397-d03d-43d8-a57b-3258359d2edd tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:53.730271 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-4e83d397-d03d-43d8-a57b-3258359d2edd tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] [instance: e8df803a-688f-4388-836b-8a16ccc26eba] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:53.737171 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4e83d397-d03d-43d8-a57b-3258359d2edd tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:53.737774 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4e83d397-d03d-43d8-a57b-3258359d2edd tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:53.738630 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4e83d397-d03d-43d8-a57b-3258359d2edd tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:53.739162 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4e83d397-d03d-43d8-a57b-3258359d2edd tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:53.746419 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-6b6cfdc8-b2cf-43f6-ac62-17fda24f7406 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:53.754417 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-6b6cfdc8-b2cf-43f6-ac62-17fda24f7406 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1" status: 200 len: 1503 microversion: 2.1 time: 0.164446 Jul 04 10:09:53.755227 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 88/172] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:53 2022] GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:53.802226 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-4e83d397-d03d-43d8-a57b-3258359d2edd tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64835c93d17543668a8039caeeaa393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f718c1e8ae45dbb633172c0ba74c5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:53.813797 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-4e83d397-d03d-43d8-a57b-3258359d2edd tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] 10.222.0.79 "GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba" status: 200 len: 1512 microversion: 2.1 time: 0.090683 Jul 04 10:09:53.814366 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 85/173] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:53 2022] GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba => generated 1512 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:53.996759 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-0b8ec720-a33e-4f89-9fb7-ac698c2aac72 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:53.997424 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-0b8ec720-a33e-4f89-9fb7-ac698c2aac72 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:54.004390 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0b8ec720-a33e-4f89-9fb7-ac698c2aac72 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:54.004650 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0b8ec720-a33e-4f89-9fb7-ac698c2aac72 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:54.005794 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0b8ec720-a33e-4f89-9fb7-ac698c2aac72 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:54.006276 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0b8ec720-a33e-4f89-9fb7-ac698c2aac72 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:54.155440 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-0b8ec720-a33e-4f89-9fb7-ac698c2aac72 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:54.163252 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-0b8ec720-a33e-4f89-9fb7-ac698c2aac72 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.170675 Jul 04 10:09:54.163935 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 89/174] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:53 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:54.772005 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-260611cc-f0ba-4a71-b243-2c72c14e5079 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:54.772630 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-260611cc-f0ba-4a71-b243-2c72c14e5079 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: fd010082-5151-49dd-8919-7c004187d9b1] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:54.779607 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-260611cc-f0ba-4a71-b243-2c72c14e5079 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:54.780179 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-260611cc-f0ba-4a71-b243-2c72c14e5079 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:54.781867 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-260611cc-f0ba-4a71-b243-2c72c14e5079 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:54.782478 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-260611cc-f0ba-4a71-b243-2c72c14e5079 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:54.831276 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-0ed7f8d8-34ed-43c1-a8c5-f1b49579a784 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:54.831982 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-0ed7f8d8-34ed-43c1-a8c5-f1b49579a784 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] [instance: e8df803a-688f-4388-836b-8a16ccc26eba] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:54.838964 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0ed7f8d8-34ed-43c1-a8c5-f1b49579a784 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:54.839655 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0ed7f8d8-34ed-43c1-a8c5-f1b49579a784 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:54.840404 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0ed7f8d8-34ed-43c1-a8c5-f1b49579a784 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:54.840833 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0ed7f8d8-34ed-43c1-a8c5-f1b49579a784 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:54.873344 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0ed7f8d8-34ed-43c1-a8c5-f1b49579a784 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:54.873818 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0ed7f8d8-34ed-43c1-a8c5-f1b49579a784 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:54.874261 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.objects.instance [None req-0ed7f8d8-34ed-43c1-a8c5-f1b49579a784 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lazy-loading 'fault' on Instance uuid e8df803a-688f-4388-836b-8a16ccc26eba {{(pid=117866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 10:09:54.933992 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-0ed7f8d8-34ed-43c1-a8c5-f1b49579a784 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64835c93d17543668a8039caeeaa393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f718c1e8ae45dbb633172c0ba74c5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:54.944093 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-0ed7f8d8-34ed-43c1-a8c5-f1b49579a784 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] 10.222.0.79 "GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba" status: 200 len: 1351 microversion: 2.1 time: 0.117422 Jul 04 10:09:54.944895 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 90/175] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:54 2022] GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba => generated 1351 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:09:54.957019 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-260611cc-f0ba-4a71-b243-2c72c14e5079 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:54.964452 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-260611cc-f0ba-4a71-b243-2c72c14e5079 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1" status: 200 len: 1503 microversion: 2.1 time: 0.196382 Jul 04 10:09:54.965022 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 86/176] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:54 2022] GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1 => generated 1503 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:55.180627 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-621a65dd-030b-4882-baa3-6114d37df4d6 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:55.181180 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-621a65dd-030b-4882-baa3-6114d37df4d6 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:55.188597 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-621a65dd-030b-4882-baa3-6114d37df4d6 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:55.189052 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-621a65dd-030b-4882-baa3-6114d37df4d6 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:55.190284 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-621a65dd-030b-4882-baa3-6114d37df4d6 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:55.190691 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-621a65dd-030b-4882-baa3-6114d37df4d6 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:55.293274 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-633d2444-99e4-4eb8-b8c6-0d31fee0003c req-282a1bb3-6908-4ff1-9a5b-36368db3d2ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd010082-5151-49dd-8919-7c004187d9b1", "name": "network-vif-deleted", "tag": "81bf9e52-9e4d-40a9-9082-fc9577c5149c"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:09:55.301714 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-633d2444-99e4-4eb8-b8c6-0d31fee0003c req-282a1bb3-6908-4ff1-9a5b-36368db3d2ca service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:55.302165 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-633d2444-99e4-4eb8-b8c6-0d31fee0003c req-282a1bb3-6908-4ff1-9a5b-36368db3d2ca service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:55.314280 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-633d2444-99e4-4eb8-b8c6-0d31fee0003c req-282a1bb3-6908-4ff1-9a5b-36368db3d2ca service nova] Creating event network-vif-deleted:81bf9e52-9e4d-40a9-9082-fc9577c5149c for instance fd010082-5151-49dd-8919-7c004187d9b1 on hv-cinder-84841 Jul 04 10:09:55.320575 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-633d2444-99e4-4eb8-b8c6-0d31fee0003c req-282a1bb3-6908-4ff1-9a5b-36368db3d2ca service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031049 Jul 04 10:09:55.329013 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 87/177] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:09:55.359409 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-621a65dd-030b-4882-baa3-6114d37df4d6 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:55.371206 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-621a65dd-030b-4882-baa3-6114d37df4d6 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.194609 Jul 04 10:09:55.374363 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 91/178] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:55 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:55.963995 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5c395cc1-6335-461a-90c8-c03d458e10ae tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:55.964620 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-5c395cc1-6335-461a-90c8-c03d458e10ae tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] [instance: e8df803a-688f-4388-836b-8a16ccc26eba] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:55.972169 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5c395cc1-6335-461a-90c8-c03d458e10ae tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:55.972608 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5c395cc1-6335-461a-90c8-c03d458e10ae tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:55.973383 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5c395cc1-6335-461a-90c8-c03d458e10ae tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:55.973836 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5c395cc1-6335-461a-90c8-c03d458e10ae tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:55.982796 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-756a7f1f-bae8-4914-92e5-9b5d6124d277 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:55.983595 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-756a7f1f-bae8-4914-92e5-9b5d6124d277 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: fd010082-5151-49dd-8919-7c004187d9b1] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:55.988192 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-5c395cc1-6335-461a-90c8-c03d458e10ae tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] HTTP exception thrown: Instance e8df803a-688f-4388-836b-8a16ccc26eba could not be found. Jul 04 10:09:55.990218 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-756a7f1f-bae8-4914-92e5-9b5d6124d277 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:55.990668 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-756a7f1f-bae8-4914-92e5-9b5d6124d277 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:55.991437 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-756a7f1f-bae8-4914-92e5-9b5d6124d277 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:55.991863 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-756a7f1f-bae8-4914-92e5-9b5d6124d277 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:55.993022 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5c395cc1-6335-461a-90c8-c03d458e10ae tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Request method failure captured: Jul 04 10:09:55.993022 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: request: GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba HTTP/1.1 Jul 04 10:09:55.993022 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept: application/json Jul 04 10:09:55.993022 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept-Encoding: identity Jul 04 10:09:55.993022 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Connection: close Jul 04 10:09:55.993022 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Length: 0 Jul 04 10:09:55.993022 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Type: application/json Jul 04 10:09:55.993022 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Host: 10.222.0.79 Jul 04 10:09:55.993022 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 04 10:09:55.993022 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 04 10:09:55.993022 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Auth-Token: gAAAAABiwrwpTNeonicg8U9eZBFBQRV2m49f4zDvVq-NU-XvQ-edTZTTRLxWquzkQ6u5OdGnlHzcOq9FhBK3L6alYC8SZXZHGxCOBpiBDSE2CgaJnUZzAAgx_tWcMY2YTLyG0iOZHlj3BZsGdgBVf-Ym5oOpzj9Q-DdO_UIK463t2aVRWImw4dY Jul 04 10:09:55.993022 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Id: None Jul 04 10:09:55.993022 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Name: None Jul 04 10:09:55.993022 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 04 10:09:55.993022 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 04 10:09:55.993022 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 04 10:09:55.993022 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 04 10:09:55.993022 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Id: c5f718c1e8ae45dbb633172c0ba74c5e Jul 04 10:09:55.993022 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Name: tempest-DeleteServersTestJSON-1125599891 Jul 04 10:09:55.993022 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Role: reader,member Jul 04 10:09:55.993022 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Roles: reader,member Jul 04 10:09:55.994325 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c5f718c1e8ae45dbb633172c0ba74c5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c5f718c1e8ae45dbb633172c0ba74c5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c5f718c1e8ae45dbb633172c0ba74c5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c5f718c1e8ae45dbb633172c0ba74c5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:09:55.994325 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant: tempest-DeleteServersTestJSON-1125599891 Jul 04 10:09:55.994325 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Id: c5f718c1e8ae45dbb633172c0ba74c5e Jul 04 10:09:55.994325 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Name: tempest-DeleteServersTestJSON-1125599891 Jul 04 10:09:55.994325 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User: tempest-DeleteServersTestJSON-1125599891-project Jul 04 10:09:55.994325 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 04 10:09:55.994325 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 04 10:09:55.994325 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Id: 64835c93d17543668a8039caeeaa393c Jul 04 10:09:55.994325 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Name: tempest-DeleteServersTestJSON-1125599891-project Jul 04 10:09:55.994325 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: method: > Jul 04 10:09:55.994325 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: exception: Instance e8df803a-688f-4388-836b-8a16ccc26eba could not be found. Jul 04 10:09:55.994325 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: action_args: {'id': 'e8df803a-688f-4388-836b-8a16ccc26eba'} Jul 04 10:09:55.998527 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:09:55.998527 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:09:55.998527 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:09:55.998527 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:09:55.998527 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:09:55.998527 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:09:55.998527 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:09:55.998527 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:09:55.998527 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:09:55.998527 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:09:55.998527 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8df803a-688f-4388-836b-8a16ccc26eba could not be found. Jul 04 10:09:55.998527 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:09:55.998527 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:09:55.998527 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:09:55.998527 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:09:55.998527 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:09:55.998527 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:09:55.998527 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:09:55.998527 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:09:55.998527 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:09:55.999939 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:09:55.999939 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 10:09:55.999939 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 10:09:55.999939 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:09:55.999939 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:09:55.999939 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:09:55.999939 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:09:55.999939 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8df803a-688f-4388-836b-8a16ccc26eba could not be found. Jul 04 10:09:55.999939 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:09:55.999939 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:09:55.999939 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:09:55.999939 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:09:55.999939 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:09:55.999939 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:09:55.999939 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:09:55.999939 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:09:55.999939 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8df803a-688f-4388-836b-8a16ccc26eba could not be found. Jul 04 10:09:55.999939 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:09:56.001191 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5c395cc1-6335-461a-90c8-c03d458e10ae tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Returning 404 to user: Instance e8df803a-688f-4388-836b-8a16ccc26eba could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:09:56.001191 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-5c395cc1-6335-461a-90c8-c03d458e10ae tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] 10.222.0.79 "GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba" status: 404 len: 111 microversion: 2.1 time: 0.036189 Jul 04 10:09:56.001191 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 88/179] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:55 2022] GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:09:56.029150 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-756a7f1f-bae8-4914-92e5-9b5d6124d277 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:56.029597 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-756a7f1f-bae8-4914-92e5-9b5d6124d277 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:56.030068 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.objects.instance [None req-756a7f1f-bae8-4914-92e5-9b5d6124d277 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lazy-loading 'fault' on Instance uuid fd010082-5151-49dd-8919-7c004187d9b1 {{(pid=117866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 10:09:56.079552 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-756a7f1f-bae8-4914-92e5-9b5d6124d277 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:56.087318 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-756a7f1f-bae8-4914-92e5-9b5d6124d277 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1" status: 200 len: 1304 microversion: 2.1 time: 0.108536 Jul 04 10:09:56.087890 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 92/180] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:55 2022] GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1 => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:56.120059 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e69db3f1-f41c-4442-9398-45f0b12f77d3 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:56.121211 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-e69db3f1-f41c-4442-9398-45f0b12f77d3 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] [instance: e8df803a-688f-4388-836b-8a16ccc26eba] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:56.130752 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e69db3f1-f41c-4442-9398-45f0b12f77d3 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:56.131401 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e69db3f1-f41c-4442-9398-45f0b12f77d3 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:56.132352 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e69db3f1-f41c-4442-9398-45f0b12f77d3 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:56.133078 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e69db3f1-f41c-4442-9398-45f0b12f77d3 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:56.155727 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-e69db3f1-f41c-4442-9398-45f0b12f77d3 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] HTTP exception thrown: Instance e8df803a-688f-4388-836b-8a16ccc26eba could not be found. Jul 04 10:09:56.157287 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e69db3f1-f41c-4442-9398-45f0b12f77d3 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Request method failure captured: Jul 04 10:09:56.157287 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: request: GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba/os-volume_attachments HTTP/1.1 Jul 04 10:09:56.157287 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept: application/json Jul 04 10:09:56.157287 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept-Encoding: identity Jul 04 10:09:56.157287 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Connection: close Jul 04 10:09:56.157287 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Length: 0 Jul 04 10:09:56.157287 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Type: application/json Jul 04 10:09:56.157287 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Host: 10.222.0.79 Jul 04 10:09:56.157287 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 04 10:09:56.157287 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 04 10:09:56.157287 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Auth-Token: gAAAAABiwrwpTNeonicg8U9eZBFBQRV2m49f4zDvVq-NU-XvQ-edTZTTRLxWquzkQ6u5OdGnlHzcOq9FhBK3L6alYC8SZXZHGxCOBpiBDSE2CgaJnUZzAAgx_tWcMY2YTLyG0iOZHlj3BZsGdgBVf-Ym5oOpzj9Q-DdO_UIK463t2aVRWImw4dY Jul 04 10:09:56.157287 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Id: None Jul 04 10:09:56.157287 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Name: None Jul 04 10:09:56.157287 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 04 10:09:56.157287 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 04 10:09:56.157287 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 04 10:09:56.157287 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 04 10:09:56.157287 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Id: c5f718c1e8ae45dbb633172c0ba74c5e Jul 04 10:09:56.157287 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Name: tempest-DeleteServersTestJSON-1125599891 Jul 04 10:09:56.157287 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Role: reader,member Jul 04 10:09:56.157287 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Roles: reader,member Jul 04 10:09:56.158844 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c5f718c1e8ae45dbb633172c0ba74c5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c5f718c1e8ae45dbb633172c0ba74c5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c5f718c1e8ae45dbb633172c0ba74c5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c5f718c1e8ae45dbb633172c0ba74c5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:09:56.158844 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant: tempest-DeleteServersTestJSON-1125599891 Jul 04 10:09:56.158844 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Id: c5f718c1e8ae45dbb633172c0ba74c5e Jul 04 10:09:56.158844 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Name: tempest-DeleteServersTestJSON-1125599891 Jul 04 10:09:56.158844 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User: tempest-DeleteServersTestJSON-1125599891-project Jul 04 10:09:56.158844 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 04 10:09:56.158844 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 04 10:09:56.158844 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Id: 64835c93d17543668a8039caeeaa393c Jul 04 10:09:56.158844 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Name: tempest-DeleteServersTestJSON-1125599891-project Jul 04 10:09:56.158844 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: method: > Jul 04 10:09:56.158844 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: exception: Instance e8df803a-688f-4388-836b-8a16ccc26eba could not be found. Jul 04 10:09:56.158844 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: action_args: {'server_id': 'e8df803a-688f-4388-836b-8a16ccc26eba'} Jul 04 10:09:56.159682 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:09:56.159682 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:09:56.159682 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:09:56.159682 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:09:56.159682 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:09:56.159682 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:09:56.159682 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:09:56.159682 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:09:56.159682 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:09:56.159682 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:09:56.159682 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8df803a-688f-4388-836b-8a16ccc26eba could not be found. Jul 04 10:09:56.159682 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:09:56.159682 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:09:56.159682 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:09:56.159682 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:09:56.159682 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:09:56.159682 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:09:56.159682 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:09:56.159682 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:09:56.159682 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:09:56.161023 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:09:56.161023 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 04 10:09:56.161023 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 10:09:56.161023 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 04 10:09:56.161023 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 10:09:56.161023 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 04 10:09:56.161023 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 04 10:09:56.161023 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:09:56.161023 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:09:56.161023 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8df803a-688f-4388-836b-8a16ccc26eba could not be found. Jul 04 10:09:56.161023 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:09:56.161023 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:09:56.161023 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:09:56.161023 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:09:56.161023 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:09:56.161023 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:09:56.161023 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:09:56.161023 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:09:56.161023 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8df803a-688f-4388-836b-8a16ccc26eba could not be found. Jul 04 10:09:56.161023 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:09:56.162496 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e69db3f1-f41c-4442-9398-45f0b12f77d3 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Returning 404 to user: Instance e8df803a-688f-4388-836b-8a16ccc26eba could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:09:56.162496 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-e69db3f1-f41c-4442-9398-45f0b12f77d3 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] 10.222.0.79 "GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.043210 Jul 04 10:09:56.162496 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 89/181] 10.222.0.79 () {58 vars in 1301 bytes} [Mon Jul 4 10:09:56 2022] GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba/os-volume_attachments => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:09:56.393316 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-2f880e18-af2c-4074-a45d-be41a8b25d1f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:56.393952 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-2f880e18-af2c-4074-a45d-be41a8b25d1f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:56.400519 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2f880e18-af2c-4074-a45d-be41a8b25d1f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:56.400964 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2f880e18-af2c-4074-a45d-be41a8b25d1f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:56.401798 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2f880e18-af2c-4074-a45d-be41a8b25d1f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:56.402227 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2f880e18-af2c-4074-a45d-be41a8b25d1f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:56.534339 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-2f880e18-af2c-4074-a45d-be41a8b25d1f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:56.542161 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-2f880e18-af2c-4074-a45d-be41a8b25d1f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.153413 Jul 04 10:09:56.542696 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 93/182] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:56 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:09:57.106642 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5a39448e-1659-4a3e-8fe5-f0a25b8ee1c6 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:57.107471 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-5a39448e-1659-4a3e-8fe5-f0a25b8ee1c6 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: fd010082-5151-49dd-8919-7c004187d9b1] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:57.114860 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5a39448e-1659-4a3e-8fe5-f0a25b8ee1c6 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:57.115289 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5a39448e-1659-4a3e-8fe5-f0a25b8ee1c6 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:57.116053 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5a39448e-1659-4a3e-8fe5-f0a25b8ee1c6 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:57.116482 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5a39448e-1659-4a3e-8fe5-f0a25b8ee1c6 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:57.133791 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-5a39448e-1659-4a3e-8fe5-f0a25b8ee1c6 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] HTTP exception thrown: Instance fd010082-5151-49dd-8919-7c004187d9b1 could not be found. Jul 04 10:09:57.135339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5a39448e-1659-4a3e-8fe5-f0a25b8ee1c6 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Request method failure captured: Jul 04 10:09:57.135339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: request: GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1 HTTP/1.1 Jul 04 10:09:57.135339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept: application/json Jul 04 10:09:57.135339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept-Encoding: identity Jul 04 10:09:57.135339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Connection: close Jul 04 10:09:57.135339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Length: 0 Jul 04 10:09:57.135339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Type: application/json Jul 04 10:09:57.135339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Host: 10.222.0.79 Jul 04 10:09:57.135339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 04 10:09:57.135339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 04 10:09:57.135339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Auth-Token: gAAAAABiwrxXFEfC8x4TpIVeFRGtRudgSplABYCHI-6MFT4ApiygB_cBsHktXv7xAi828TLmsH-L8tFoapije5lgAsmJ1H7VMjjfoxAHAQty5oPW9ZOC-nzdr2jjduq4z10x_6Dd6rNcyH_AB7VEbDFiSvSIJKDjjE1XhNkkk42Qp5uAKeqCiA8 Jul 04 10:09:57.135339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Id: None Jul 04 10:09:57.135339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Name: None Jul 04 10:09:57.135339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 04 10:09:57.135339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 04 10:09:57.135339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 04 10:09:57.135339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 04 10:09:57.135339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Id: 59fcbc120f0d4dc48dc0b3f2e7433b1a Jul 04 10:09:57.135339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Name: tempest-VolumesActionsTest-503029100 Jul 04 10:09:57.135339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Role: reader,member Jul 04 10:09:57.135339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Roles: reader,member Jul 04 10:09:57.136544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59fcbc120f0d4dc48dc0b3f2e7433b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59fcbc120f0d4dc48dc0b3f2e7433b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59fcbc120f0d4dc48dc0b3f2e7433b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59fcbc120f0d4dc48dc0b3f2e7433b1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:09:57.136544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant: tempest-VolumesActionsTest-503029100 Jul 04 10:09:57.136544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Id: 59fcbc120f0d4dc48dc0b3f2e7433b1a Jul 04 10:09:57.136544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Name: tempest-VolumesActionsTest-503029100 Jul 04 10:09:57.136544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User: tempest-VolumesActionsTest-503029100-project Jul 04 10:09:57.136544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 04 10:09:57.136544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 04 10:09:57.136544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Id: 348d6a68d7c84200899be9e72aeaded6 Jul 04 10:09:57.136544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Name: tempest-VolumesActionsTest-503029100-project Jul 04 10:09:57.136544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: method: > Jul 04 10:09:57.136544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: exception: Instance fd010082-5151-49dd-8919-7c004187d9b1 could not be found. Jul 04 10:09:57.136544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: action_args: {'id': 'fd010082-5151-49dd-8919-7c004187d9b1'} Jul 04 10:09:57.137198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:09:57.137198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:09:57.137198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:09:57.137198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:09:57.137198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:09:57.137198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:09:57.137198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:09:57.137198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:09:57.137198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:09:57.137198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:09:57.137198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd010082-5151-49dd-8919-7c004187d9b1 could not be found. Jul 04 10:09:57.137198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:09:57.137198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:09:57.137198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:09:57.137198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:09:57.137198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:09:57.137198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:09:57.137198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:09:57.137198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:09:57.137198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:09:57.138266 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:09:57.138266 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 10:09:57.138266 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 10:09:57.138266 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:09:57.138266 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:09:57.138266 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:09:57.138266 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:09:57.138266 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd010082-5151-49dd-8919-7c004187d9b1 could not be found. Jul 04 10:09:57.138266 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:09:57.138266 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:09:57.138266 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:09:57.138266 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:09:57.138266 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:09:57.138266 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:09:57.138266 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:09:57.138266 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:09:57.138266 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd010082-5151-49dd-8919-7c004187d9b1 could not be found. Jul 04 10:09:57.138266 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:09:57.139184 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5a39448e-1659-4a3e-8fe5-f0a25b8ee1c6 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Returning 404 to user: Instance fd010082-5151-49dd-8919-7c004187d9b1 could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:09:57.139184 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-5a39448e-1659-4a3e-8fe5-f0a25b8ee1c6 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1" status: 404 len: 111 microversion: 2.1 time: 0.034297 Jul 04 10:09:57.139184 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 90/183] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:57 2022] GET /compute/v2.1/servers/fd010082-5151-49dd-8919-7c004187d9b1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:09:57.261637 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-fa0783ac-fed0-430a-9cb9-ea78b37ec3c4 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-297692111", "imageRef": "80bd29b0-b77c-4611-be31-69ca559a2d2a", "flavorRef": "452", "networks": [{"uuid": "b221b5cf-f562-4b2f-a2b8-71ec29c35306"}]}} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:09:57.313896 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.network.neutron [None req-fa0783ac-fed0-430a-9cb9-ea78b37ec3c4 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] validate_networks() for [('b221b5cf-f562-4b2f-a2b8-71ec29c35306', None, None, None, None, None)] {{(pid=117866) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 10:09:57.373849 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-7fcec97c-cb0b-41b1-ae3b-fde034f256c1 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:57.374579 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-7fcec97c-cb0b-41b1-ae3b-fde034f256c1 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] [instance: e8df803a-688f-4388-836b-8a16ccc26eba] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:57.386449 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7fcec97c-cb0b-41b1-ae3b-fde034f256c1 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:57.387289 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7fcec97c-cb0b-41b1-ae3b-fde034f256c1 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:57.390932 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7fcec97c-cb0b-41b1-ae3b-fde034f256c1 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:57.391461 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7fcec97c-cb0b-41b1-ae3b-fde034f256c1 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:57.407387 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-7fcec97c-cb0b-41b1-ae3b-fde034f256c1 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] HTTP exception thrown: Instance e8df803a-688f-4388-836b-8a16ccc26eba could not be found. Jul 04 10:09:57.409171 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-7fcec97c-cb0b-41b1-ae3b-fde034f256c1 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Request method failure captured: Jul 04 10:09:57.409171 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: request: DELETE /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba HTTP/1.1 Jul 04 10:09:57.409171 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept: application/json Jul 04 10:09:57.409171 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept-Encoding: identity Jul 04 10:09:57.409171 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Connection: close Jul 04 10:09:57.409171 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Length: 0 Jul 04 10:09:57.409171 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Type: application/json Jul 04 10:09:57.409171 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Host: 10.222.0.79 Jul 04 10:09:57.409171 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 04 10:09:57.409171 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 04 10:09:57.409171 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Auth-Token: gAAAAABiwrwpTNeonicg8U9eZBFBQRV2m49f4zDvVq-NU-XvQ-edTZTTRLxWquzkQ6u5OdGnlHzcOq9FhBK3L6alYC8SZXZHGxCOBpiBDSE2CgaJnUZzAAgx_tWcMY2YTLyG0iOZHlj3BZsGdgBVf-Ym5oOpzj9Q-DdO_UIK463t2aVRWImw4dY Jul 04 10:09:57.409171 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Id: None Jul 04 10:09:57.409171 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Name: None Jul 04 10:09:57.409171 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 04 10:09:57.409171 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 04 10:09:57.409171 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 04 10:09:57.409171 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 04 10:09:57.409171 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Id: c5f718c1e8ae45dbb633172c0ba74c5e Jul 04 10:09:57.409171 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Name: tempest-DeleteServersTestJSON-1125599891 Jul 04 10:09:57.409171 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Role: reader,member Jul 04 10:09:57.409171 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Roles: reader,member Jul 04 10:09:57.410426 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c5f718c1e8ae45dbb633172c0ba74c5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c5f718c1e8ae45dbb633172c0ba74c5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c5f718c1e8ae45dbb633172c0ba74c5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c5f718c1e8ae45dbb633172c0ba74c5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:09:57.410426 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant: tempest-DeleteServersTestJSON-1125599891 Jul 04 10:09:57.410426 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Id: c5f718c1e8ae45dbb633172c0ba74c5e Jul 04 10:09:57.410426 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Name: tempest-DeleteServersTestJSON-1125599891 Jul 04 10:09:57.410426 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User: tempest-DeleteServersTestJSON-1125599891-project Jul 04 10:09:57.410426 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 04 10:09:57.410426 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 04 10:09:57.410426 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Id: 64835c93d17543668a8039caeeaa393c Jul 04 10:09:57.410426 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Name: tempest-DeleteServersTestJSON-1125599891-project Jul 04 10:09:57.410426 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: method: > Jul 04 10:09:57.410426 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: exception: Instance e8df803a-688f-4388-836b-8a16ccc26eba could not be found. Jul 04 10:09:57.410426 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: action_args: {'id': 'e8df803a-688f-4388-836b-8a16ccc26eba'} Jul 04 10:09:57.411090 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:09:57.411090 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:09:57.411090 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:09:57.411090 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:09:57.411090 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:09:57.411090 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:09:57.411090 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:09:57.411090 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:09:57.411090 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:09:57.411090 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:09:57.411090 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8df803a-688f-4388-836b-8a16ccc26eba could not be found. Jul 04 10:09:57.411090 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:09:57.411090 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:09:57.411090 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:09:57.411090 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:09:57.411090 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:09:57.411090 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:09:57.411090 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:09:57.411090 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:09:57.411090 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:09:57.412152 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:09:57.412152 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 10:09:57.412152 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 10:09:57.412152 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 10:09:57.412152 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 10:09:57.412152 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:09:57.412152 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:09:57.412152 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:09:57.412152 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:09:57.412152 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8df803a-688f-4388-836b-8a16ccc26eba could not be found. Jul 04 10:09:57.412152 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:09:57.412152 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:09:57.412152 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:09:57.412152 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:09:57.412152 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:09:57.412152 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:09:57.412152 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:09:57.412152 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:09:57.412152 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8df803a-688f-4388-836b-8a16ccc26eba could not be found. Jul 04 10:09:57.412152 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:09:57.413241 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-7fcec97c-cb0b-41b1-ae3b-fde034f256c1 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Returning 404 to user: Instance e8df803a-688f-4388-836b-8a16ccc26eba could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:09:57.413241 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-7fcec97c-cb0b-41b1-ae3b-fde034f256c1 tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba" status: 404 len: 111 microversion: 2.1 time: 0.041006 Jul 04 10:09:57.413241 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 91/184] 10.222.0.79 () {58 vars in 1238 bytes} [Mon Jul 4 10:09:57 2022] DELETE /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 04 10:09:57.421412 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-76c025b4-f0f1-40a1-93e5-64251a73fb4f tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:57.422156 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-76c025b4-f0f1-40a1-93e5-64251a73fb4f tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] [instance: e8df803a-688f-4388-836b-8a16ccc26eba] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:57.429846 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-76c025b4-f0f1-40a1-93e5-64251a73fb4f tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:57.430284 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-76c025b4-f0f1-40a1-93e5-64251a73fb4f tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:57.431283 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-76c025b4-f0f1-40a1-93e5-64251a73fb4f tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:57.431714 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-76c025b4-f0f1-40a1-93e5-64251a73fb4f tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:57.449325 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-76c025b4-f0f1-40a1-93e5-64251a73fb4f tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] HTTP exception thrown: Instance e8df803a-688f-4388-836b-8a16ccc26eba could not be found. Jul 04 10:09:57.451278 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-76c025b4-f0f1-40a1-93e5-64251a73fb4f tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Request method failure captured: Jul 04 10:09:57.451278 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: request: GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba HTTP/1.1 Jul 04 10:09:57.451278 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept: application/json Jul 04 10:09:57.451278 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept-Encoding: identity Jul 04 10:09:57.451278 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Connection: close Jul 04 10:09:57.451278 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Length: 0 Jul 04 10:09:57.451278 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Type: application/json Jul 04 10:09:57.451278 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Host: 10.222.0.79 Jul 04 10:09:57.451278 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 04 10:09:57.451278 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 04 10:09:57.451278 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Auth-Token: gAAAAABiwrwpTNeonicg8U9eZBFBQRV2m49f4zDvVq-NU-XvQ-edTZTTRLxWquzkQ6u5OdGnlHzcOq9FhBK3L6alYC8SZXZHGxCOBpiBDSE2CgaJnUZzAAgx_tWcMY2YTLyG0iOZHlj3BZsGdgBVf-Ym5oOpzj9Q-DdO_UIK463t2aVRWImw4dY Jul 04 10:09:57.451278 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Id: None Jul 04 10:09:57.451278 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Name: None Jul 04 10:09:57.451278 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 04 10:09:57.451278 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 04 10:09:57.451278 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 04 10:09:57.451278 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 04 10:09:57.451278 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Id: c5f718c1e8ae45dbb633172c0ba74c5e Jul 04 10:09:57.451278 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Name: tempest-DeleteServersTestJSON-1125599891 Jul 04 10:09:57.451278 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Role: reader,member Jul 04 10:09:57.451278 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Roles: reader,member Jul 04 10:09:57.453009 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c5f718c1e8ae45dbb633172c0ba74c5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c5f718c1e8ae45dbb633172c0ba74c5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c5f718c1e8ae45dbb633172c0ba74c5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c5f718c1e8ae45dbb633172c0ba74c5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:09:57.453009 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant: tempest-DeleteServersTestJSON-1125599891 Jul 04 10:09:57.453009 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Id: c5f718c1e8ae45dbb633172c0ba74c5e Jul 04 10:09:57.453009 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Name: tempest-DeleteServersTestJSON-1125599891 Jul 04 10:09:57.453009 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User: tempest-DeleteServersTestJSON-1125599891-project Jul 04 10:09:57.453009 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 04 10:09:57.453009 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 04 10:09:57.453009 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Id: 64835c93d17543668a8039caeeaa393c Jul 04 10:09:57.453009 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Name: tempest-DeleteServersTestJSON-1125599891-project Jul 04 10:09:57.453009 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: method: > Jul 04 10:09:57.453009 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: exception: Instance e8df803a-688f-4388-836b-8a16ccc26eba could not be found. Jul 04 10:09:57.453009 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: action_args: {'id': 'e8df803a-688f-4388-836b-8a16ccc26eba'} Jul 04 10:09:57.453946 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:09:57.453946 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:09:57.453946 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:09:57.453946 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:09:57.453946 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:09:57.453946 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:09:57.453946 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:09:57.453946 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:09:57.453946 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:09:57.453946 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:09:57.453946 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8df803a-688f-4388-836b-8a16ccc26eba could not be found. Jul 04 10:09:57.453946 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:09:57.453946 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:09:57.453946 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:09:57.453946 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:09:57.453946 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:09:57.453946 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:09:57.453946 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:09:57.453946 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:09:57.453946 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:09:57.455033 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:09:57.455033 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 10:09:57.455033 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 10:09:57.455033 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:09:57.455033 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:09:57.455033 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:09:57.455033 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:09:57.455033 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8df803a-688f-4388-836b-8a16ccc26eba could not be found. Jul 04 10:09:57.455033 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:09:57.455033 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:09:57.455033 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:09:57.455033 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:09:57.455033 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:09:57.455033 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:09:57.455033 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:09:57.455033 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:09:57.455033 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8df803a-688f-4388-836b-8a16ccc26eba could not be found. Jul 04 10:09:57.455033 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:09:57.456819 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-76c025b4-f0f1-40a1-93e5-64251a73fb4f tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] Returning 404 to user: Instance e8df803a-688f-4388-836b-8a16ccc26eba could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:09:57.457830 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-76c025b4-f0f1-40a1-93e5-64251a73fb4f tempest-DeleteServersTestJSON-1125599891 tempest-DeleteServersTestJSON-1125599891-project] 10.222.0.79 "GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba" status: 404 len: 111 microversion: 2.1 time: 0.040103 Jul 04 10:09:57.458526 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 92/185] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:57 2022] GET /compute/v2.1/servers/e8df803a-688f-4388-836b-8a16ccc26eba => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 04 10:09:57.565081 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-42590f5a-93fd-42ac-9387-c3863eb36f89 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:57.566270 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-42590f5a-93fd-42ac-9387-c3863eb36f89 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:57.581794 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-42590f5a-93fd-42ac-9387-c3863eb36f89 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:57.582364 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-42590f5a-93fd-42ac-9387-c3863eb36f89 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:57.584229 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-42590f5a-93fd-42ac-9387-c3863eb36f89 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:57.584617 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-42590f5a-93fd-42ac-9387-c3863eb36f89 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:57.815770 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-42590f5a-93fd-42ac-9387-c3863eb36f89 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:57.823112 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-42590f5a-93fd-42ac-9387-c3863eb36f89 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.262576 Jul 04 10:09:57.823756 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 93/186] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:57 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:57.880801 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-fa0783ac-fed0-430a-9cb9-ea78b37ec3c4 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Flavor limits 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 10:09:57.881214 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-fa0783ac-fed0-430a-9cb9-ea78b37ec3c4 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Image limits 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 10:09:57.881689 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-fa0783ac-fed0-430a-9cb9-ea78b37ec3c4 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Flavor pref 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 10:09:57.882112 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-fa0783ac-fed0-430a-9cb9-ea78b37ec3c4 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Image pref 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 10:09:57.882504 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-fa0783ac-fed0-430a-9cb9-ea78b37ec3c4 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 10:09:57.891695 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-fa0783ac-fed0-430a-9cb9-ea78b37ec3c4 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:57.892481 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-fa0783ac-fed0-430a-9cb9-ea78b37ec3c4 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:57.893280 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-fa0783ac-fed0-430a-9cb9-ea78b37ec3c4 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:57.893708 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-fa0783ac-fed0-430a-9cb9-ea78b37ec3c4 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:57.913922 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.quota [None req-fa0783ac-fed0-430a-9cb9-ea78b37ec3c4 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Getting quotas for project 59fcbc120f0d4dc48dc0b3f2e7433b1a. Resources: {'cores', 'ram', 'instances'} {{(pid=117866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 10:09:57.918658 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.quota [None req-fa0783ac-fed0-430a-9cb9-ea78b37ec3c4 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Getting quotas for user 348d6a68d7c84200899be9e72aeaded6 and project 59fcbc120f0d4dc48dc0b3f2e7433b1a. Resources: {'cores', 'ram', 'instances'} {{(pid=117866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 10:09:57.931077 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-fa0783ac-fed0-430a-9cb9-ea78b37ec3c4 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Going to run 1 instances... {{(pid=117866) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 10:09:57.933905 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-fa0783ac-fed0-430a-9cb9-ea78b37ec3c4 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: 5f3e98bd-4dad-418d-8b37-1141d1f8fac6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80bd29b0-b77c-4611-be31-69ca559a2d2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 10:09:57.985428 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-fa0783ac-fed0-430a-9cb9-ea78b37ec3c4 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.727459 Jul 04 10:09:57.986913 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 94/187] 10.222.0.79 () {60 vars in 1146 bytes} [Mon Jul 4 10:09:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 10:09:57.998199 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-cf916b52-cbb5-45e9-a4e4-94f8dd245d23 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:57.999085 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-cf916b52-cbb5-45e9-a4e4-94f8dd245d23 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: 5f3e98bd-4dad-418d-8b37-1141d1f8fac6] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:58.081457 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-cf916b52-cbb5-45e9-a4e4-94f8dd245d23 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:58.099989 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-cf916b52-cbb5-45e9-a4e4-94f8dd245d23 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6" status: 200 len: 1213 microversion: 2.1 time: 0.105917 Jul 04 10:09:58.100822 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 94/188] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:57 2022] GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6 => generated 1213 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:09:58.840772 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-829ab0e8-627b-41e5-9711-e45c3d8ab5ff tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:58.841991 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-829ab0e8-627b-41e5-9711-e45c3d8ab5ff tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:58.850064 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-829ab0e8-627b-41e5-9711-e45c3d8ab5ff tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:58.850547 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-829ab0e8-627b-41e5-9711-e45c3d8ab5ff tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:58.851376 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-829ab0e8-627b-41e5-9711-e45c3d8ab5ff tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:58.851987 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-829ab0e8-627b-41e5-9711-e45c3d8ab5ff tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:59.066504 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-829ab0e8-627b-41e5-9711-e45c3d8ab5ff tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:59.082024 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-829ab0e8-627b-41e5-9711-e45c3d8ab5ff tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.245426 Jul 04 10:09:59.082668 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 95/189] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:58 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:09:59.116309 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-bf3fbd08-6468-49aa-a6de-603aa63e474c tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:09:59.117557 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-bf3fbd08-6468-49aa-a6de-603aa63e474c tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: 5f3e98bd-4dad-418d-8b37-1141d1f8fac6] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:09:59.125834 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bf3fbd08-6468-49aa-a6de-603aa63e474c tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:59.126726 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bf3fbd08-6468-49aa-a6de-603aa63e474c tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:59.128215 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bf3fbd08-6468-49aa-a6de-603aa63e474c tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:09:59.128656 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bf3fbd08-6468-49aa-a6de-603aa63e474c tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:09:59.209712 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-bf3fbd08-6468-49aa-a6de-603aa63e474c tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:09:59.220920 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-bf3fbd08-6468-49aa-a6de-603aa63e474c tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6" status: 200 len: 1265 microversion: 2.1 time: 0.108262 Jul 04 10:09:59.221503 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 95/190] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:09:59 2022] GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6 => generated 1265 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:00.099238 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-a92f6d6d-9d94-4764-89d5-dca1c2618f65 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:00.100506 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-a92f6d6d-9d94-4764-89d5-dca1c2618f65 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:00.106929 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a92f6d6d-9d94-4764-89d5-dca1c2618f65 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:00.107645 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a92f6d6d-9d94-4764-89d5-dca1c2618f65 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:00.108880 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a92f6d6d-9d94-4764-89d5-dca1c2618f65 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:00.109513 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a92f6d6d-9d94-4764-89d5-dca1c2618f65 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:00.114396 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:00.237406 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f8045162-aad8-45ca-b5ce-ef2703d4610d tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:00.238727 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f8045162-aad8-45ca-b5ce-ef2703d4610d tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: 5f3e98bd-4dad-418d-8b37-1141d1f8fac6] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:00.246006 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f8045162-aad8-45ca-b5ce-ef2703d4610d tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:00.246530 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f8045162-aad8-45ca-b5ce-ef2703d4610d tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:00.247588 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f8045162-aad8-45ca-b5ce-ef2703d4610d tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:00.248172 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f8045162-aad8-45ca-b5ce-ef2703d4610d tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:00.265068 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-a92f6d6d-9d94-4764-89d5-dca1c2618f65 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:00.274383 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-a92f6d6d-9d94-4764-89d5-dca1c2618f65 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.178941 Jul 04 10:10:00.276119 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 96/191] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:00 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:00.333594 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-f8045162-aad8-45ca-b5ce-ef2703d4610d tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:00.341862 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f8045162-aad8-45ca-b5ce-ef2703d4610d tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6" status: 200 len: 1271 microversion: 2.1 time: 0.108237 Jul 04 10:10:00.342444 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 96/192] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:00 2022] GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6 => generated 1271 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:10:01.298792 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-7de07a75-e9c6-4805-8d32-4d95c57520a5 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:01.299392 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-7de07a75-e9c6-4805-8d32-4d95c57520a5 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:01.307154 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7de07a75-e9c6-4805-8d32-4d95c57520a5 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:01.307595 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7de07a75-e9c6-4805-8d32-4d95c57520a5 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:01.308364 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7de07a75-e9c6-4805-8d32-4d95c57520a5 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:01.308776 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7de07a75-e9c6-4805-8d32-4d95c57520a5 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:01.359924 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-fdd297fc-0921-4c14-b0e4-b82feb5a1095 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:01.361326 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-fdd297fc-0921-4c14-b0e4-b82feb5a1095 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: 5f3e98bd-4dad-418d-8b37-1141d1f8fac6] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:01.367560 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:01.369228 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fdd297fc-0921-4c14-b0e4-b82feb5a1095 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:01.369860 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fdd297fc-0921-4c14-b0e4-b82feb5a1095 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:01.370769 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fdd297fc-0921-4c14-b0e4-b82feb5a1095 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:01.371334 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fdd297fc-0921-4c14-b0e4-b82feb5a1095 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:01.522083 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-7de07a75-e9c6-4805-8d32-4d95c57520a5 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:01.530390 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-7de07a75-e9c6-4805-8d32-4d95c57520a5 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.241190 Jul 04 10:10:01.530889 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 97/193] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:01 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:01.573982 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-fdd297fc-0921-4c14-b0e4-b82feb5a1095 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:01.582121 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-fdd297fc-0921-4c14-b0e4-b82feb5a1095 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6" status: 200 len: 1313 microversion: 2.1 time: 0.225991 Jul 04 10:10:01.582715 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 97/194] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:01 2022] GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:02.256399 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-d801b3c8-5cdf-480f-b329-6c82ee9db710 req-6438a804-a19c-4295-b0aa-b12f9cece36d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f3e98bd-4dad-418d-8b37-1141d1f8fac6", "tag": "01d0eebc-9fe5-47d9-8541-c4fa60f22058"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:10:02.266134 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-d801b3c8-5cdf-480f-b329-6c82ee9db710 req-6438a804-a19c-4295-b0aa-b12f9cece36d service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:02.267163 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-d801b3c8-5cdf-480f-b329-6c82ee9db710 req-6438a804-a19c-4295-b0aa-b12f9cece36d service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:02.287131 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-d801b3c8-5cdf-480f-b329-6c82ee9db710 req-6438a804-a19c-4295-b0aa-b12f9cece36d service nova] Creating event network-changed:01d0eebc-9fe5-47d9-8541-c4fa60f22058 for instance 5f3e98bd-4dad-418d-8b37-1141d1f8fac6 on hv-cinder-84841 Jul 04 10:10:02.293825 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-d801b3c8-5cdf-480f-b329-6c82ee9db710 req-6438a804-a19c-4295-b0aa-b12f9cece36d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041794 Jul 04 10:10:02.294544 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 98/195] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:10:02.547526 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5a178e33-5378-46ad-ae31-cb907421f67e tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:02.548721 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-5a178e33-5378-46ad-ae31-cb907421f67e tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:02.556387 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5a178e33-5378-46ad-ae31-cb907421f67e tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:02.556861 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5a178e33-5378-46ad-ae31-cb907421f67e tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:02.557930 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5a178e33-5378-46ad-ae31-cb907421f67e tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:02.558252 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5a178e33-5378-46ad-ae31-cb907421f67e tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:02.602037 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-013056fc-475a-458e-9a6c-60b9506cb3ca tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:02.606794 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-013056fc-475a-458e-9a6c-60b9506cb3ca tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: 5f3e98bd-4dad-418d-8b37-1141d1f8fac6] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:02.614965 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-013056fc-475a-458e-9a6c-60b9506cb3ca tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:02.615737 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-013056fc-475a-458e-9a6c-60b9506cb3ca tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:02.616591 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-013056fc-475a-458e-9a6c-60b9506cb3ca tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:02.617074 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-013056fc-475a-458e-9a6c-60b9506cb3ca tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:02.776035 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-5a178e33-5378-46ad-ae31-cb907421f67e tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:02.784596 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-5a178e33-5378-46ad-ae31-cb907421f67e tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.240989 Jul 04 10:10:02.794852 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 98/196] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:02 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:02.818922 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-013056fc-475a-458e-9a6c-60b9506cb3ca tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:02.828765 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-013056fc-475a-458e-9a6c-60b9506cb3ca tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6" status: 200 len: 1313 microversion: 2.1 time: 0.231750 Jul 04 10:10:02.829366 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 99/197] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:02 2022] GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:03.801448 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-bb0a7414-4926-4a78-87cc-4245c2edc9bf tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:03.802286 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-bb0a7414-4926-4a78-87cc-4245c2edc9bf tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:03.810087 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bb0a7414-4926-4a78-87cc-4245c2edc9bf tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:03.810725 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bb0a7414-4926-4a78-87cc-4245c2edc9bf tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:03.811583 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bb0a7414-4926-4a78-87cc-4245c2edc9bf tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:03.812318 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bb0a7414-4926-4a78-87cc-4245c2edc9bf tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:03.847420 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-894ce4f1-e9af-46c7-9fba-dacf963e3dd2 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:03.848032 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-894ce4f1-e9af-46c7-9fba-dacf963e3dd2 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: 5f3e98bd-4dad-418d-8b37-1141d1f8fac6] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:03.854556 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-894ce4f1-e9af-46c7-9fba-dacf963e3dd2 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:03.855040 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-894ce4f1-e9af-46c7-9fba-dacf963e3dd2 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:03.855799 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-894ce4f1-e9af-46c7-9fba-dacf963e3dd2 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:03.856195 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-894ce4f1-e9af-46c7-9fba-dacf963e3dd2 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:04.024640 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-bb0a7414-4926-4a78-87cc-4245c2edc9bf tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:04.033180 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-bb0a7414-4926-4a78-87cc-4245c2edc9bf tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.235610 Jul 04 10:10:04.035355 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 99/198] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:03 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:04.062834 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-894ce4f1-e9af-46c7-9fba-dacf963e3dd2 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:04.071598 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-894ce4f1-e9af-46c7-9fba-dacf963e3dd2 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6" status: 200 len: 1313 microversion: 2.1 time: 0.229463 Jul 04 10:10:04.072194 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 100/199] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:03 2022] GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6 => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:10:05.051527 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-19ed2d06-7d3b-4a63-a27b-5fe1f442773b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:05.052116 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-19ed2d06-7d3b-4a63-a27b-5fe1f442773b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:05.058973 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-19ed2d06-7d3b-4a63-a27b-5fe1f442773b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:05.059409 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-19ed2d06-7d3b-4a63-a27b-5fe1f442773b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:05.060154 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-19ed2d06-7d3b-4a63-a27b-5fe1f442773b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:05.060575 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-19ed2d06-7d3b-4a63-a27b-5fe1f442773b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:05.063124 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=100 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:05.088489 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-aa627624-bc16-44f1-b00e-e7dfe45fe952 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:05.089123 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-aa627624-bc16-44f1-b00e-e7dfe45fe952 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: 5f3e98bd-4dad-418d-8b37-1141d1f8fac6] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:05.096028 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-aa627624-bc16-44f1-b00e-e7dfe45fe952 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:05.096455 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-aa627624-bc16-44f1-b00e-e7dfe45fe952 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:05.097240 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-aa627624-bc16-44f1-b00e-e7dfe45fe952 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:05.097655 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-aa627624-bc16-44f1-b00e-e7dfe45fe952 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:05.243668 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-19ed2d06-7d3b-4a63-a27b-5fe1f442773b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:05.252073 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-19ed2d06-7d3b-4a63-a27b-5fe1f442773b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.204417 Jul 04 10:10:05.252739 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 100/200] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:05 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:05.269653 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-aa627624-bc16-44f1-b00e-e7dfe45fe952 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:05.277499 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-aa627624-bc16-44f1-b00e-e7dfe45fe952 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6" status: 200 len: 1313 microversion: 2.1 time: 0.192888 Jul 04 10:10:05.278117 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 101/201] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:05 2022] GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:06.268863 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8293b749-b100-4362-b549-deb438b381bb tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:06.270078 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-8293b749-b100-4362-b549-deb438b381bb tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:06.277150 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8293b749-b100-4362-b549-deb438b381bb tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:06.277802 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8293b749-b100-4362-b549-deb438b381bb tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:06.278717 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8293b749-b100-4362-b549-deb438b381bb tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:06.279340 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8293b749-b100-4362-b549-deb438b381bb tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:06.295481 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-c8b34467-e99a-4707-8bc0-3a30eb538c06 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:06.296161 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-c8b34467-e99a-4707-8bc0-3a30eb538c06 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: 5f3e98bd-4dad-418d-8b37-1141d1f8fac6] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:06.304681 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c8b34467-e99a-4707-8bc0-3a30eb538c06 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:06.305128 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c8b34467-e99a-4707-8bc0-3a30eb538c06 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:06.306129 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c8b34467-e99a-4707-8bc0-3a30eb538c06 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:06.306646 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c8b34467-e99a-4707-8bc0-3a30eb538c06 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:06.671976 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-8293b749-b100-4362-b549-deb438b381bb tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:06.681177 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-8293b749-b100-4362-b549-deb438b381bb tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.415958 Jul 04 10:10:06.691484 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 101/202] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:06 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:06.695969 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-c8b34467-e99a-4707-8bc0-3a30eb538c06 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:06.703901 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-c8b34467-e99a-4707-8bc0-3a30eb538c06 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6" status: 200 len: 1313 microversion: 2.1 time: 0.413012 Jul 04 10:10:06.704667 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 102/203] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:06 2022] GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6 => generated 1313 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:07.463430 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-904a37e2-b0a2-4a48-93cc-163226987cc2 req-de763a3c-0100-41f3-92e2-21242dfaee80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f3e98bd-4dad-418d-8b37-1141d1f8fac6", "name": "network-vif-plugged", "status": "completed", "tag": "01d0eebc-9fe5-47d9-8541-c4fa60f22058"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:10:07.472369 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-904a37e2-b0a2-4a48-93cc-163226987cc2 req-de763a3c-0100-41f3-92e2-21242dfaee80 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:07.472807 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-904a37e2-b0a2-4a48-93cc-163226987cc2 req-de763a3c-0100-41f3-92e2-21242dfaee80 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:07.484599 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-904a37e2-b0a2-4a48-93cc-163226987cc2 req-de763a3c-0100-41f3-92e2-21242dfaee80 service nova] Creating event network-vif-plugged:01d0eebc-9fe5-47d9-8541-c4fa60f22058 for instance 5f3e98bd-4dad-418d-8b37-1141d1f8fac6 on hv-cinder-84841 Jul 04 10:10:07.490125 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-904a37e2-b0a2-4a48-93cc-163226987cc2 req-de763a3c-0100-41f3-92e2-21242dfaee80 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031008 Jul 04 10:10:07.490977 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 102/204] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:10:07.698809 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-1e65b15c-8498-41d8-9f39-a6190d4c3bf1 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:07.699439 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-1e65b15c-8498-41d8-9f39-a6190d4c3bf1 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:07.705783 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1e65b15c-8498-41d8-9f39-a6190d4c3bf1 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:07.706226 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1e65b15c-8498-41d8-9f39-a6190d4c3bf1 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:07.706992 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1e65b15c-8498-41d8-9f39-a6190d4c3bf1 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:07.707425 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1e65b15c-8498-41d8-9f39-a6190d4c3bf1 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:07.721999 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-1d283352-d5ba-487e-8071-c2d58afa37ec tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:07.722701 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-1d283352-d5ba-487e-8071-c2d58afa37ec tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: 5f3e98bd-4dad-418d-8b37-1141d1f8fac6] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:07.738956 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1d283352-d5ba-487e-8071-c2d58afa37ec tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:07.739833 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1d283352-d5ba-487e-8071-c2d58afa37ec tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:07.740850 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1d283352-d5ba-487e-8071-c2d58afa37ec tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:07.741823 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1d283352-d5ba-487e-8071-c2d58afa37ec tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:07.902714 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-1e65b15c-8498-41d8-9f39-a6190d4c3bf1 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:07.905116 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell0:SELECT=2 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:07.912640 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-1e65b15c-8498-41d8-9f39-a6190d4c3bf1 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.217558 Jul 04 10:10:07.913680 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 103/205] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:07 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:07.942774 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-1d283352-d5ba-487e-8071-c2d58afa37ec tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:07.950519 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-1d283352-d5ba-487e-8071-c2d58afa37ec tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6" status: 200 len: 1313 microversion: 2.1 time: 0.233248 Jul 04 10:10:07.951098 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 103/206] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:07 2022] GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:10:08.931939 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-9f42476d-57c6-4448-8b9e-524ea75c7fdd tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:08.932554 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-9f42476d-57c6-4448-8b9e-524ea75c7fdd tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:08.934376 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell0:SELECT=6 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:08.939943 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9f42476d-57c6-4448-8b9e-524ea75c7fdd tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:08.940383 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9f42476d-57c6-4448-8b9e-524ea75c7fdd tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:08.941138 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9f42476d-57c6-4448-8b9e-524ea75c7fdd tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:08.941560 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9f42476d-57c6-4448-8b9e-524ea75c7fdd tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:08.968271 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5ca74084-53e4-4e80-b746-6d62e1e9e0d4 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:08.969289 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-5ca74084-53e4-4e80-b746-6d62e1e9e0d4 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: 5f3e98bd-4dad-418d-8b37-1141d1f8fac6] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:08.971366 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:08.978104 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5ca74084-53e4-4e80-b746-6d62e1e9e0d4 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:08.978615 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5ca74084-53e4-4e80-b746-6d62e1e9e0d4 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:08.979447 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5ca74084-53e4-4e80-b746-6d62e1e9e0d4 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:08.979919 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5ca74084-53e4-4e80-b746-6d62e1e9e0d4 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:09.121058 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-9f42476d-57c6-4448-8b9e-524ea75c7fdd tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:09.137979 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-9f42476d-57c6-4448-8b9e-524ea75c7fdd tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.210109 Jul 04 10:10:09.138568 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 104/207] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:08 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:09.151561 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-5ca74084-53e4-4e80-b746-6d62e1e9e0d4 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:09.159231 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-5ca74084-53e4-4e80-b746-6d62e1e9e0d4 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6" status: 200 len: 1313 microversion: 2.1 time: 0.194830 Jul 04 10:10:09.159765 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 104/208] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:08 2022] GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:10.156386 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-428f5dd1-ca3b-4956-b68a-4364e171bbc2 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:10.157136 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-428f5dd1-ca3b-4956-b68a-4364e171bbc2 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:10.164304 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-428f5dd1-ca3b-4956-b68a-4364e171bbc2 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:10.164753 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-428f5dd1-ca3b-4956-b68a-4364e171bbc2 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:10.165815 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-428f5dd1-ca3b-4956-b68a-4364e171bbc2 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:10.166246 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-428f5dd1-ca3b-4956-b68a-4364e171bbc2 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:10.179759 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-c77506aa-d12c-4dea-9933-aadcfc27b40e tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:10.180403 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-c77506aa-d12c-4dea-9933-aadcfc27b40e tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: 5f3e98bd-4dad-418d-8b37-1141d1f8fac6] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:10.187695 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c77506aa-d12c-4dea-9933-aadcfc27b40e tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:10.187828 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c77506aa-d12c-4dea-9933-aadcfc27b40e tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:10.188756 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c77506aa-d12c-4dea-9933-aadcfc27b40e tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:10.189400 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c77506aa-d12c-4dea-9933-aadcfc27b40e tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:10.366302 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-428f5dd1-ca3b-4956-b68a-4364e171bbc2 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:10.372391 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-c77506aa-d12c-4dea-9933-aadcfc27b40e tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:10.374163 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-428f5dd1-ca3b-4956-b68a-4364e171bbc2 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.222491 Jul 04 10:10:10.374743 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 105/209] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:10 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:10.380343 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-c77506aa-d12c-4dea-9933-aadcfc27b40e tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6" status: 200 len: 1313 microversion: 2.1 time: 0.207620 Jul 04 10:10:10.380898 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 105/210] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:10 2022] GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6 => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:11.395978 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-d675bb1f-1e51-4e00-b98c-c324ded5c432 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:11.397300 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-d675bb1f-1e51-4e00-b98c-c324ded5c432 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:11.399985 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8e47236c-1b47-4d8e-91f8-3e15c32bb60e tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:11.400696 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:11.400983 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-8e47236c-1b47-4d8e-91f8-3e15c32bb60e tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: 5f3e98bd-4dad-418d-8b37-1141d1f8fac6] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:11.409487 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d675bb1f-1e51-4e00-b98c-c324ded5c432 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:11.410260 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d675bb1f-1e51-4e00-b98c-c324ded5c432 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:11.411790 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d675bb1f-1e51-4e00-b98c-c324ded5c432 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:11.412264 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d675bb1f-1e51-4e00-b98c-c324ded5c432 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:11.412401 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8e47236c-1b47-4d8e-91f8-3e15c32bb60e tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:11.412821 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8e47236c-1b47-4d8e-91f8-3e15c32bb60e tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:11.413573 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8e47236c-1b47-4d8e-91f8-3e15c32bb60e tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:11.414016 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8e47236c-1b47-4d8e-91f8-3e15c32bb60e tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:11.617209 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-d675bb1f-1e51-4e00-b98c-c324ded5c432 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:11.620730 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-8e47236c-1b47-4d8e-91f8-3e15c32bb60e tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:11.625159 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-d675bb1f-1e51-4e00-b98c-c324ded5c432 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.235843 Jul 04 10:10:11.625733 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 106/211] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:11 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:11.628633 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-8e47236c-1b47-4d8e-91f8-3e15c32bb60e tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6" status: 200 len: 1313 microversion: 2.1 time: 0.235031 Jul 04 10:10:11.629270 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 106/212] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:11 2022] GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6 => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:12.648748 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-579cd984-0745-499c-b276-c092e2a03b37 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:12.650270 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-d6525a69-def1-4443-9075-8ec9f387f65a tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:12.651200 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d6525a69-def1-4443-9075-8ec9f387f65a tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: 5f3e98bd-4dad-418d-8b37-1141d1f8fac6] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:12.652300 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-579cd984-0745-499c-b276-c092e2a03b37 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:12.665794 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-579cd984-0745-499c-b276-c092e2a03b37 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:12.668007 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-579cd984-0745-499c-b276-c092e2a03b37 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:12.668980 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d6525a69-def1-4443-9075-8ec9f387f65a tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:12.669607 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d6525a69-def1-4443-9075-8ec9f387f65a tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:12.670435 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-579cd984-0745-499c-b276-c092e2a03b37 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:12.671529 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d6525a69-def1-4443-9075-8ec9f387f65a tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:12.672195 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-579cd984-0745-499c-b276-c092e2a03b37 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:12.676793 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d6525a69-def1-4443-9075-8ec9f387f65a tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:12.879489 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-579cd984-0745-499c-b276-c092e2a03b37 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:12.883386 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-d6525a69-def1-4443-9075-8ec9f387f65a tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:12.887587 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-579cd984-0745-499c-b276-c092e2a03b37 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.248820 Jul 04 10:10:12.888172 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 107/213] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:12 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:12.891236 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-d6525a69-def1-4443-9075-8ec9f387f65a tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6" status: 200 len: 1313 microversion: 2.1 time: 0.249909 Jul 04 10:10:12.891834 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 107/214] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:12 2022] GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:13.904847 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-c74c2859-07f8-4c79-8a62-8dbc1cef07cb tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:13.906164 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-c74c2859-07f8-4c79-8a62-8dbc1cef07cb tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:13.910299 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f9b5bdc7-3792-43fa-a38b-b0da0da392a5 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:13.910869 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f9b5bdc7-3792-43fa-a38b-b0da0da392a5 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: 5f3e98bd-4dad-418d-8b37-1141d1f8fac6] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:13.913176 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c74c2859-07f8-4c79-8a62-8dbc1cef07cb tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:13.913748 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c74c2859-07f8-4c79-8a62-8dbc1cef07cb tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:13.914916 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c74c2859-07f8-4c79-8a62-8dbc1cef07cb tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:13.915504 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c74c2859-07f8-4c79-8a62-8dbc1cef07cb tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:13.918400 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f9b5bdc7-3792-43fa-a38b-b0da0da392a5 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:13.919052 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f9b5bdc7-3792-43fa-a38b-b0da0da392a5 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:13.921767 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f9b5bdc7-3792-43fa-a38b-b0da0da392a5 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:13.922228 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f9b5bdc7-3792-43fa-a38b-b0da0da392a5 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:14.118374 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-c74c2859-07f8-4c79-8a62-8dbc1cef07cb tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:14.120846 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-f9b5bdc7-3792-43fa-a38b-b0da0da392a5 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:14.128549 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f9b5bdc7-3792-43fa-a38b-b0da0da392a5 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6" status: 200 len: 1496 microversion: 2.1 time: 0.224264 Jul 04 10:10:14.129315 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 108/215] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:13 2022] GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6 => generated 1496 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:10:14.131045 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-c74c2859-07f8-4c79-8a62-8dbc1cef07cb tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.230157 Jul 04 10:10:14.131967 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 108/216] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:13 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:14.606777 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-3b731c20-88f6-448d-9eda-c0b0c99cafeb tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:14.607802 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-3b731c20-88f6-448d-9eda-c0b0c99cafeb tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: 5f3e98bd-4dad-418d-8b37-1141d1f8fac6] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:14.614090 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3b731c20-88f6-448d-9eda-c0b0c99cafeb tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:14.614898 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3b731c20-88f6-448d-9eda-c0b0c99cafeb tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:14.615708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3b731c20-88f6-448d-9eda-c0b0c99cafeb tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:14.616141 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3b731c20-88f6-448d-9eda-c0b0c99cafeb tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:14.641643 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-3b731c20-88f6-448d-9eda-c0b0c99cafeb tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: 5f3e98bd-4dad-418d-8b37-1141d1f8fac6] Going to try to terminate instance {{(pid=117865) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 10:10:14.722539 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-3b731c20-88f6-448d-9eda-c0b0c99cafeb tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "DELETE /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6" status: 204 len: 0 microversion: 2.1 time: 0.120004 Jul 04 10:10:14.723618 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 109/217] 10.222.0.79 () {58 vars in 1238 bytes} [Mon Jul 4 10:10:14 2022] DELETE /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 10:10:14.732200 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-8561b6c9-f819-41b3-b9f6-9c8b82810d4d tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:14.732816 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-8561b6c9-f819-41b3-b9f6-9c8b82810d4d tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: 5f3e98bd-4dad-418d-8b37-1141d1f8fac6] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:14.738894 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8561b6c9-f819-41b3-b9f6-9c8b82810d4d tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:14.739332 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8561b6c9-f819-41b3-b9f6-9c8b82810d4d tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:14.740084 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8561b6c9-f819-41b3-b9f6-9c8b82810d4d tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:14.740515 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8561b6c9-f819-41b3-b9f6-9c8b82810d4d tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:14.879215 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-8561b6c9-f819-41b3-b9f6-9c8b82810d4d tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:14.887196 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-8561b6c9-f819-41b3-b9f6-9c8b82810d4d tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6" status: 200 len: 1502 microversion: 2.1 time: 0.159190 Jul 04 10:10:14.887801 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 109/218] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:14 2022] GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6 => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:15.149509 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f19624df-085b-4e3c-8713-1adc0732fed8 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:15.150269 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f19624df-085b-4e3c-8713-1adc0732fed8 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:15.157531 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f19624df-085b-4e3c-8713-1adc0732fed8 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:15.158014 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f19624df-085b-4e3c-8713-1adc0732fed8 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:15.158781 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f19624df-085b-4e3c-8713-1adc0732fed8 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:15.159240 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f19624df-085b-4e3c-8713-1adc0732fed8 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:15.291020 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-f19624df-085b-4e3c-8713-1adc0732fed8 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:15.299487 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f19624df-085b-4e3c-8713-1adc0732fed8 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.154726 Jul 04 10:10:15.300064 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 110/219] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:15 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:15.905162 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-10a9229d-13e4-4a55-acb8-f0bcb6654d59 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:15.906026 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-10a9229d-13e4-4a55-acb8-f0bcb6654d59 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: 5f3e98bd-4dad-418d-8b37-1141d1f8fac6] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:15.913810 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-10a9229d-13e4-4a55-acb8-f0bcb6654d59 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:15.914900 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-10a9229d-13e4-4a55-acb8-f0bcb6654d59 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:15.915714 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-10a9229d-13e4-4a55-acb8-f0bcb6654d59 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:15.916191 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-10a9229d-13e4-4a55-acb8-f0bcb6654d59 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:16.058470 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-10a9229d-13e4-4a55-acb8-f0bcb6654d59 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:16.066461 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-10a9229d-13e4-4a55-acb8-f0bcb6654d59 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6" status: 200 len: 1502 microversion: 2.1 time: 0.165901 Jul 04 10:10:16.067355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 110/220] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:15 2022] GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6 => generated 1502 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:16.317798 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-13b98b15-f47f-46d4-93c4-808a7623103b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:16.318439 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-13b98b15-f47f-46d4-93c4-808a7623103b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:16.325194 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-13b98b15-f47f-46d4-93c4-808a7623103b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:16.325698 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-13b98b15-f47f-46d4-93c4-808a7623103b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:16.326674 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-13b98b15-f47f-46d4-93c4-808a7623103b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:16.327412 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-13b98b15-f47f-46d4-93c4-808a7623103b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:16.483612 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-13b98b15-f47f-46d4-93c4-808a7623103b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:16.491822 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-13b98b15-f47f-46d4-93c4-808a7623103b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.178657 Jul 04 10:10:16.492522 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 111/221] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:16 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:16.884414 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-e7483554-9429-4937-b9e3-3147342cd206 req-3e661dde-8101-4e72-858a-545808bb8836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f3e98bd-4dad-418d-8b37-1141d1f8fac6", "name": "network-vif-deleted", "tag": "01d0eebc-9fe5-47d9-8541-c4fa60f22058"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:10:16.892532 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-e7483554-9429-4937-b9e3-3147342cd206 req-3e661dde-8101-4e72-858a-545808bb8836 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:16.892960 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-e7483554-9429-4937-b9e3-3147342cd206 req-3e661dde-8101-4e72-858a-545808bb8836 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:16.904851 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-e7483554-9429-4937-b9e3-3147342cd206 req-3e661dde-8101-4e72-858a-545808bb8836 service nova] Creating event network-vif-deleted:01d0eebc-9fe5-47d9-8541-c4fa60f22058 for instance 5f3e98bd-4dad-418d-8b37-1141d1f8fac6 on hv-cinder-84841 Jul 04 10:10:16.911153 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-e7483554-9429-4937-b9e3-3147342cd206 req-3e661dde-8101-4e72-858a-545808bb8836 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030800 Jul 04 10:10:16.915170 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 111/222] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:10:17.083935 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-3e976dd8-7033-4dba-8738-ead65b76cd71 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:17.084575 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-3e976dd8-7033-4dba-8738-ead65b76cd71 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: 5f3e98bd-4dad-418d-8b37-1141d1f8fac6] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:17.091056 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3e976dd8-7033-4dba-8738-ead65b76cd71 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:17.091492 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3e976dd8-7033-4dba-8738-ead65b76cd71 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:17.092271 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3e976dd8-7033-4dba-8738-ead65b76cd71 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:17.092692 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3e976dd8-7033-4dba-8738-ead65b76cd71 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:17.162183 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-3e976dd8-7033-4dba-8738-ead65b76cd71 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:17.170512 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-3e976dd8-7033-4dba-8738-ead65b76cd71 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6" status: 200 len: 1460 microversion: 2.1 time: 0.090433 Jul 04 10:10:17.177775 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 112/223] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:17 2022] GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6 => generated 1460 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:17.513961 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-17ad7dd2-c71f-47ce-9ade-ce43cf0243d2 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:17.515681 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-17ad7dd2-c71f-47ce-9ade-ce43cf0243d2 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:17.523920 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-17ad7dd2-c71f-47ce-9ade-ce43cf0243d2 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:17.524313 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-17ad7dd2-c71f-47ce-9ade-ce43cf0243d2 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:17.525072 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-17ad7dd2-c71f-47ce-9ade-ce43cf0243d2 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:17.525701 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-17ad7dd2-c71f-47ce-9ade-ce43cf0243d2 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:17.673134 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-17ad7dd2-c71f-47ce-9ade-ce43cf0243d2 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:17.682645 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-17ad7dd2-c71f-47ce-9ade-ce43cf0243d2 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.177329 Jul 04 10:10:17.683323 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 112/224] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:17 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:18.191913 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-dcaf2083-64ef-4c64-80ca-87cbd0733f8f tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:18.192679 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-dcaf2083-64ef-4c64-80ca-87cbd0733f8f tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: 5f3e98bd-4dad-418d-8b37-1141d1f8fac6] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:18.200183 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-dcaf2083-64ef-4c64-80ca-87cbd0733f8f tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:18.200722 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-dcaf2083-64ef-4c64-80ca-87cbd0733f8f tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:18.201554 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-dcaf2083-64ef-4c64-80ca-87cbd0733f8f tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:18.202088 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-dcaf2083-64ef-4c64-80ca-87cbd0733f8f tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:18.239483 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-dcaf2083-64ef-4c64-80ca-87cbd0733f8f tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:18.239939 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-dcaf2083-64ef-4c64-80ca-87cbd0733f8f tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:18.240743 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.objects.instance [None req-dcaf2083-64ef-4c64-80ca-87cbd0733f8f tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lazy-loading 'fault' on Instance uuid 5f3e98bd-4dad-418d-8b37-1141d1f8fac6 {{(pid=117865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 10:10:18.292172 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-dcaf2083-64ef-4c64-80ca-87cbd0733f8f tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '348d6a68d7c84200899be9e72aeaded6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59fcbc120f0d4dc48dc0b3f2e7433b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:18.310382 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-dcaf2083-64ef-4c64-80ca-87cbd0733f8f tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6" status: 200 len: 1303 microversion: 2.1 time: 0.125079 Jul 04 10:10:18.311380 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 113/225] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:18 2022] GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6 => generated 1303 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:18.701902 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-8177a5a9-4bb3-4cef-a73c-696fbbb086e9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:18.704065 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-8177a5a9-4bb3-4cef-a73c-696fbbb086e9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:18.710879 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8177a5a9-4bb3-4cef-a73c-696fbbb086e9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:18.711363 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8177a5a9-4bb3-4cef-a73c-696fbbb086e9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:18.712162 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8177a5a9-4bb3-4cef-a73c-696fbbb086e9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:18.712575 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8177a5a9-4bb3-4cef-a73c-696fbbb086e9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:18.851674 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-8177a5a9-4bb3-4cef-a73c-696fbbb086e9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:18.859372 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-8177a5a9-4bb3-4cef-a73c-696fbbb086e9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1521 microversion: 2.1 time: 0.162335 Jul 04 10:10:18.859932 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 113/226] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:18 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:19.330103 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-3adc5a4c-654e-4b75-9b9e-c5458f8f8063 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:19.330805 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-3adc5a4c-654e-4b75-9b9e-c5458f8f8063 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] [instance: 5f3e98bd-4dad-418d-8b37-1141d1f8fac6] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:19.337706 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3adc5a4c-654e-4b75-9b9e-c5458f8f8063 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:19.338774 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3adc5a4c-654e-4b75-9b9e-c5458f8f8063 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:19.339797 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3adc5a4c-654e-4b75-9b9e-c5458f8f8063 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:19.340468 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3adc5a4c-654e-4b75-9b9e-c5458f8f8063 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:19.357009 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-3adc5a4c-654e-4b75-9b9e-c5458f8f8063 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] HTTP exception thrown: Instance 5f3e98bd-4dad-418d-8b37-1141d1f8fac6 could not be found. Jul 04 10:10:19.358691 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-3adc5a4c-654e-4b75-9b9e-c5458f8f8063 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Request method failure captured: Jul 04 10:10:19.358691 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: request: GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6 HTTP/1.1 Jul 04 10:10:19.358691 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept: application/json Jul 04 10:10:19.358691 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept-Encoding: identity Jul 04 10:10:19.358691 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Connection: close Jul 04 10:10:19.358691 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Length: 0 Jul 04 10:10:19.358691 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Type: application/json Jul 04 10:10:19.358691 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Host: 10.222.0.79 Jul 04 10:10:19.358691 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 04 10:10:19.358691 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 04 10:10:19.358691 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Auth-Token: gAAAAABiwrxXFEfC8x4TpIVeFRGtRudgSplABYCHI-6MFT4ApiygB_cBsHktXv7xAi828TLmsH-L8tFoapije5lgAsmJ1H7VMjjfoxAHAQty5oPW9ZOC-nzdr2jjduq4z10x_6Dd6rNcyH_AB7VEbDFiSvSIJKDjjE1XhNkkk42Qp5uAKeqCiA8 Jul 04 10:10:19.358691 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Id: None Jul 04 10:10:19.358691 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Name: None Jul 04 10:10:19.358691 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 04 10:10:19.358691 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 04 10:10:19.358691 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 04 10:10:19.358691 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 04 10:10:19.358691 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Id: 59fcbc120f0d4dc48dc0b3f2e7433b1a Jul 04 10:10:19.358691 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Name: tempest-VolumesActionsTest-503029100 Jul 04 10:10:19.358691 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Role: reader,member Jul 04 10:10:19.358691 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Roles: reader,member Jul 04 10:10:19.359927 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59fcbc120f0d4dc48dc0b3f2e7433b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59fcbc120f0d4dc48dc0b3f2e7433b1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59fcbc120f0d4dc48dc0b3f2e7433b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59fcbc120f0d4dc48dc0b3f2e7433b1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:10:19.359927 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant: tempest-VolumesActionsTest-503029100 Jul 04 10:10:19.359927 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Id: 59fcbc120f0d4dc48dc0b3f2e7433b1a Jul 04 10:10:19.359927 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Name: tempest-VolumesActionsTest-503029100 Jul 04 10:10:19.359927 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User: tempest-VolumesActionsTest-503029100-project Jul 04 10:10:19.359927 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 04 10:10:19.359927 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 04 10:10:19.359927 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Id: 348d6a68d7c84200899be9e72aeaded6 Jul 04 10:10:19.359927 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Name: tempest-VolumesActionsTest-503029100-project Jul 04 10:10:19.359927 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: method: > Jul 04 10:10:19.359927 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: exception: Instance 5f3e98bd-4dad-418d-8b37-1141d1f8fac6 could not be found. Jul 04 10:10:19.359927 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: action_args: {'id': '5f3e98bd-4dad-418d-8b37-1141d1f8fac6'} Jul 04 10:10:19.360620 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:10:19.360620 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:10:19.360620 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:10:19.360620 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:10:19.360620 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:10:19.360620 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:10:19.360620 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:10:19.360620 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:10:19.360620 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:10:19.360620 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:10:19.360620 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f3e98bd-4dad-418d-8b37-1141d1f8fac6 could not be found. Jul 04 10:10:19.360620 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:10:19.360620 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:10:19.360620 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:10:19.360620 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:10:19.360620 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:10:19.360620 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:10:19.360620 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:10:19.360620 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:10:19.360620 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:10:19.362264 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:10:19.362264 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 10:10:19.362264 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 10:10:19.362264 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:10:19.362264 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:10:19.362264 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:10:19.362264 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:10:19.362264 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f3e98bd-4dad-418d-8b37-1141d1f8fac6 could not be found. Jul 04 10:10:19.362264 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:10:19.362264 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:10:19.362264 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:10:19.362264 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:10:19.362264 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:10:19.362264 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:10:19.362264 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:10:19.362264 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:10:19.362264 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f3e98bd-4dad-418d-8b37-1141d1f8fac6 could not be found. Jul 04 10:10:19.362264 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:10:19.363249 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-3adc5a4c-654e-4b75-9b9e-c5458f8f8063 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] Returning 404 to user: Instance 5f3e98bd-4dad-418d-8b37-1141d1f8fac6 could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:10:19.363249 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-3adc5a4c-654e-4b75-9b9e-c5458f8f8063 tempest-VolumesActionsTest-503029100 tempest-VolumesActionsTest-503029100-project] 10.222.0.79 "GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6" status: 404 len: 111 microversion: 2.1 time: 0.033949 Jul 04 10:10:19.363249 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 114/227] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:19 2022] GET /compute/v2.1/servers/5f3e98bd-4dad-418d-8b37-1141d1f8fac6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:10:19.876723 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-5fa38f77-9b74-4d22-840a-9cef303bdb81 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:19.877322 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-5fa38f77-9b74-4d22-840a-9cef303bdb81 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:19.884887 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5fa38f77-9b74-4d22-840a-9cef303bdb81 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:19.885877 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5fa38f77-9b74-4d22-840a-9cef303bdb81 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:19.887636 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5fa38f77-9b74-4d22-840a-9cef303bdb81 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:19.888362 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5fa38f77-9b74-4d22-840a-9cef303bdb81 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:19.893875 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell1:SELECT=100 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:20.050155 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-5fa38f77-9b74-4d22-840a-9cef303bdb81 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:20.058078 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-5fa38f77-9b74-4d22-840a-9cef303bdb81 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1501 microversion: 2.1 time: 0.185564 Jul 04 10:10:20.058664 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 114/228] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:19 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1501 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:20.074952 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-dd9c6197-f446-4b5c-9bb6-e35aa9425a1b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:20.075569 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-dd9c6197-f446-4b5c-9bb6-e35aa9425a1b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:20.081702 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-dd9c6197-f446-4b5c-9bb6-e35aa9425a1b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:20.082150 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-dd9c6197-f446-4b5c-9bb6-e35aa9425a1b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:20.082909 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-dd9c6197-f446-4b5c-9bb6-e35aa9425a1b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:20.083341 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-dd9c6197-f446-4b5c-9bb6-e35aa9425a1b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:20.366436 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-dd9c6197-f446-4b5c-9bb6-e35aa9425a1b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:20.374457 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-dd9c6197-f446-4b5c-9bb6-e35aa9425a1b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120" status: 200 len: 1515 microversion: 2.1 time: 0.304303 Jul 04 10:10:20.386167 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 115/229] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:20 2022] GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120 => generated 1515 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:23.916132 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-d8cfc34d-9324-4ce0-b053-b475c7d649df tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:10:23.917067 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-d8cfc34d-9324-4ce0-b053-b475c7d649df tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:23.926455 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d8cfc34d-9324-4ce0-b053-b475c7d649df tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:23.927125 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d8cfc34d-9324-4ce0-b053-b475c7d649df tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:23.928372 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d8cfc34d-9324-4ce0-b053-b475c7d649df tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:23.929159 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d8cfc34d-9324-4ce0-b053-b475c7d649df tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:23.959720 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.objects.instance [None req-d8cfc34d-9324-4ce0-b053-b475c7d649df tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lazy-loading 'flavor' on Instance uuid 068a560b-f200-4046-a36b-7ef23cea5120 {{(pid=117866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 10:10:24.038463 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-d8cfc34d-9324-4ce0-b053-b475c7d649df tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "POST /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120/action" status: 200 len: 32 microversion: 2.1 time: 0.126616 Jul 04 10:10:24.039153 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 115/230] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Jul 4 10:10:23 2022] POST /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120/action => generated 32 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 10:10:24.048343 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-053a30f0-b416-4a04-bb4e-f604b55b744b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:24.049130 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-053a30f0-b416-4a04-bb4e-f604b55b744b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:24.055791 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-053a30f0-b416-4a04-bb4e-f604b55b744b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:24.056449 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-053a30f0-b416-4a04-bb4e-f604b55b744b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:24.057231 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-053a30f0-b416-4a04-bb4e-f604b55b744b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:24.057835 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-053a30f0-b416-4a04-bb4e-f604b55b744b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:24.060540 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:24.200855 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-053a30f0-b416-4a04-bb4e-f604b55b744b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:24.216878 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-053a30f0-b416-4a04-bb4e-f604b55b744b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120" status: 200 len: 1521 microversion: 2.1 time: 0.172349 Jul 04 10:10:24.217469 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 116/231] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:24 2022] GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:10:25.235767 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-36cd06e5-4992-44b8-b29a-9375c753233c tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:25.236463 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-36cd06e5-4992-44b8-b29a-9375c753233c tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:25.243453 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-36cd06e5-4992-44b8-b29a-9375c753233c tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:25.243898 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-36cd06e5-4992-44b8-b29a-9375c753233c tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:25.244667 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-36cd06e5-4992-44b8-b29a-9375c753233c tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:25.245095 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-36cd06e5-4992-44b8-b29a-9375c753233c tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:25.387736 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-36cd06e5-4992-44b8-b29a-9375c753233c tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:25.395428 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-36cd06e5-4992-44b8-b29a-9375c753233c tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120" status: 200 len: 1521 microversion: 2.1 time: 0.164606 Jul 04 10:10:25.395994 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 116/232] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:25 2022] GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:26.412400 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-3f348f90-d0f9-4d1e-896e-25df74177034 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:26.412922 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-3f348f90-d0f9-4d1e-896e-25df74177034 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:26.420123 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3f348f90-d0f9-4d1e-896e-25df74177034 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:26.420567 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3f348f90-d0f9-4d1e-896e-25df74177034 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:26.421317 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3f348f90-d0f9-4d1e-896e-25df74177034 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:26.421754 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3f348f90-d0f9-4d1e-896e-25df74177034 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:26.555014 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-3f348f90-d0f9-4d1e-896e-25df74177034 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:26.564625 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-3f348f90-d0f9-4d1e-896e-25df74177034 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120" status: 200 len: 1521 microversion: 2.1 time: 0.156093 Jul 04 10:10:26.565185 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 117/233] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:26 2022] GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:27.581070 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-d0b2e308-0906-44ff-be80-b90b12275507 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:27.581953 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-d0b2e308-0906-44ff-be80-b90b12275507 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:27.588219 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d0b2e308-0906-44ff-be80-b90b12275507 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:27.588667 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d0b2e308-0906-44ff-be80-b90b12275507 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:27.589431 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d0b2e308-0906-44ff-be80-b90b12275507 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:27.590015 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d0b2e308-0906-44ff-be80-b90b12275507 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:27.774472 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-d0b2e308-0906-44ff-be80-b90b12275507 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:27.782005 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-d0b2e308-0906-44ff-be80-b90b12275507 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120" status: 200 len: 1521 microversion: 2.1 time: 0.204919 Jul 04 10:10:27.782575 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 117/234] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:27 2022] GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:28.804533 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-900e51e9-1313-4760-8ce0-3e82869648e8 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:28.804533 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-900e51e9-1313-4760-8ce0-3e82869648e8 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:28.814304 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-900e51e9-1313-4760-8ce0-3e82869648e8 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:28.814748 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-900e51e9-1313-4760-8ce0-3e82869648e8 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:28.821559 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-900e51e9-1313-4760-8ce0-3e82869648e8 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:28.825816 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-900e51e9-1313-4760-8ce0-3e82869648e8 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:28.993556 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-900e51e9-1313-4760-8ce0-3e82869648e8 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:29.003589 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-900e51e9-1313-4760-8ce0-3e82869648e8 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120" status: 200 len: 1521 microversion: 2.1 time: 0.207453 Jul 04 10:10:29.004450 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 118/235] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:28 2022] GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:30.020594 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-895572ec-a3b2-4eca-98a9-83e6ca7df03f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:30.021231 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-895572ec-a3b2-4eca-98a9-83e6ca7df03f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:30.028042 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-895572ec-a3b2-4eca-98a9-83e6ca7df03f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:30.028549 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-895572ec-a3b2-4eca-98a9-83e6ca7df03f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:30.029310 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-895572ec-a3b2-4eca-98a9-83e6ca7df03f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:30.029787 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-895572ec-a3b2-4eca-98a9-83e6ca7df03f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:30.166457 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-895572ec-a3b2-4eca-98a9-83e6ca7df03f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:30.174531 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-895572ec-a3b2-4eca-98a9-83e6ca7df03f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120" status: 200 len: 1521 microversion: 2.1 time: 0.157886 Jul 04 10:10:30.175098 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 118/236] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:30 2022] GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:31.192628 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-4b3ec453-e1e4-413d-b98a-b6b61c8bc3b0 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:31.193224 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-4b3ec453-e1e4-413d-b98a-b6b61c8bc3b0 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:31.200486 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4b3ec453-e1e4-413d-b98a-b6b61c8bc3b0 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:31.200959 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4b3ec453-e1e4-413d-b98a-b6b61c8bc3b0 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:31.201708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4b3ec453-e1e4-413d-b98a-b6b61c8bc3b0 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:31.202175 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4b3ec453-e1e4-413d-b98a-b6b61c8bc3b0 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:31.349463 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-4b3ec453-e1e4-413d-b98a-b6b61c8bc3b0 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:31.357952 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-4b3ec453-e1e4-413d-b98a-b6b61c8bc3b0 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120" status: 200 len: 1521 microversion: 2.1 time: 0.169068 Jul 04 10:10:31.358837 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 119/237] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:31 2022] GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:32.376690 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-aef9e07e-ad78-40eb-9576-d6721c5a24a9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:32.377301 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-aef9e07e-ad78-40eb-9576-d6721c5a24a9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:32.383947 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-aef9e07e-ad78-40eb-9576-d6721c5a24a9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:32.384555 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-aef9e07e-ad78-40eb-9576-d6721c5a24a9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:32.385439 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-aef9e07e-ad78-40eb-9576-d6721c5a24a9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:32.386029 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-aef9e07e-ad78-40eb-9576-d6721c5a24a9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:32.553957 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-aef9e07e-ad78-40eb-9576-d6721c5a24a9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:32.563333 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-aef9e07e-ad78-40eb-9576-d6721c5a24a9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120" status: 200 len: 1521 microversion: 2.1 time: 0.191069 Jul 04 10:10:32.563919 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 119/238] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:32 2022] GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:33.583486 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-0f0e9f2b-182c-4c34-a0cf-eddb3c26bd61 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:33.584597 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-0f0e9f2b-182c-4c34-a0cf-eddb3c26bd61 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:33.592136 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:33.594360 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0f0e9f2b-182c-4c34-a0cf-eddb3c26bd61 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:33.595373 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0f0e9f2b-182c-4c34-a0cf-eddb3c26bd61 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:33.596533 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0f0e9f2b-182c-4c34-a0cf-eddb3c26bd61 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:33.597106 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0f0e9f2b-182c-4c34-a0cf-eddb3c26bd61 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:33.797475 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-0f0e9f2b-182c-4c34-a0cf-eddb3c26bd61 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:33.807239 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-0f0e9f2b-182c-4c34-a0cf-eddb3c26bd61 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120" status: 200 len: 1521 microversion: 2.1 time: 0.230616 Jul 04 10:10:33.817992 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 120/239] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:33 2022] GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:34.826835 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-e62a288b-7e2e-467f-9c7f-a1c859b137f3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:34.827450 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-e62a288b-7e2e-467f-9c7f-a1c859b137f3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:34.838973 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e62a288b-7e2e-467f-9c7f-a1c859b137f3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:34.839903 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e62a288b-7e2e-467f-9c7f-a1c859b137f3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:34.841559 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e62a288b-7e2e-467f-9c7f-a1c859b137f3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:34.842442 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e62a288b-7e2e-467f-9c7f-a1c859b137f3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:35.116549 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-564f6c6a-91de-4f8c-a463-ac15fab4373d tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:35.117250 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-564f6c6a-91de-4f8c-a463-ac15fab4373d tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:35.128341 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-564f6c6a-91de-4f8c-a463-ac15fab4373d tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:35.135523 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-564f6c6a-91de-4f8c-a463-ac15fab4373d tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:35.135523 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-564f6c6a-91de-4f8c-a463-ac15fab4373d tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:35.135523 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-564f6c6a-91de-4f8c-a463-ac15fab4373d tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:35.174735 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-564f6c6a-91de-4f8c-a463-ac15fab4373d tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7/ips" status: 200 len: 145 microversion: 2.1 time: 0.062196 Jul 04 10:10:35.176052 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 121/240] 10.222.0.79 () {58 vars in 1247 bytes} [Mon Jul 4 10:10:35 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7/ips => generated 145 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 10:10:35.198654 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-e62a288b-7e2e-467f-9c7f-a1c859b137f3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:35.208299 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-e62a288b-7e2e-467f-9c7f-a1c859b137f3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120" status: 200 len: 1521 microversion: 2.1 time: 0.387544 Jul 04 10:10:35.209431 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 120/241] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:34 2022] GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120 => generated 1521 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:10:36.228824 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-74fe74b2-9a1c-40e4-ace1-2d3cb5745b93 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:36.229425 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-74fe74b2-9a1c-40e4-ace1-2d3cb5745b93 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:36.243159 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-74fe74b2-9a1c-40e4-ace1-2d3cb5745b93 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:36.243597 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-74fe74b2-9a1c-40e4-ace1-2d3cb5745b93 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:36.244372 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-74fe74b2-9a1c-40e4-ace1-2d3cb5745b93 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:36.244843 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-74fe74b2-9a1c-40e4-ace1-2d3cb5745b93 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:36.431977 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-74fe74b2-9a1c-40e4-ace1-2d3cb5745b93 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:36.443248 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-74fe74b2-9a1c-40e4-ace1-2d3cb5745b93 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120" status: 200 len: 1521 microversion: 2.1 time: 0.218546 Jul 04 10:10:36.444124 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 122/242] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:36 2022] GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:37.462228 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-7031c1f5-75a2-4c55-ae98-80f3aac55262 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:37.463526 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-7031c1f5-75a2-4c55-ae98-80f3aac55262 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:37.477008 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7031c1f5-75a2-4c55-ae98-80f3aac55262 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:37.477608 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7031c1f5-75a2-4c55-ae98-80f3aac55262 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:37.479408 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7031c1f5-75a2-4c55-ae98-80f3aac55262 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:37.480497 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7031c1f5-75a2-4c55-ae98-80f3aac55262 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:37.721035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-7031c1f5-75a2-4c55-ae98-80f3aac55262 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:37.734031 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-7031c1f5-75a2-4c55-ae98-80f3aac55262 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120" status: 200 len: 1521 microversion: 2.1 time: 0.275556 Jul 04 10:10:37.734728 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 121/243] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:37 2022] GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120 => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:37.762714 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-48b4bb97-9512-4bdd-907f-8f7755ccfa17 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31799a2a-3fed-4b86-ba34-2f4e8154195a"}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:10:37.764623 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-48b4bb97-9512-4bdd-907f-8f7755ccfa17 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:37.771492 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-48b4bb97-9512-4bdd-907f-8f7755ccfa17 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:37.772124 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-48b4bb97-9512-4bdd-907f-8f7755ccfa17 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:37.773195 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-48b4bb97-9512-4bdd-907f-8f7755ccfa17 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:37.773781 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-48b4bb97-9512-4bdd-907f-8f7755ccfa17 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:38.321155 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-48b4bb97-9512-4bdd-907f-8f7755ccfa17 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "POST /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.558895 Jul 04 10:10:38.321155 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 123/244] 10.222.0.79 () {60 vars in 1322 bytes} [Mon Jul 4 10:10:37 2022] POST /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7/os-volume_attachments => generated 194 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:10:38.751995 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-9d73727f-c022-42fd-9568-423ee44e24e3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:38.752606 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-9d73727f-c022-42fd-9568-423ee44e24e3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:38.758993 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9d73727f-c022-42fd-9568-423ee44e24e3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:38.759794 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9d73727f-c022-42fd-9568-423ee44e24e3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:38.760810 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9d73727f-c022-42fd-9568-423ee44e24e3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:38.761329 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9d73727f-c022-42fd-9568-423ee44e24e3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:38.897660 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-9d73727f-c022-42fd-9568-423ee44e24e3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:38.905348 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-9d73727f-c022-42fd-9568-423ee44e24e3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120" status: 200 len: 1521 microversion: 2.1 time: 0.157470 Jul 04 10:10:38.906049 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 122/245] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:38 2022] GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:39.804211 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-1cecc02c-769b-422a-9360-f9718251c524 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:39.804791 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-1cecc02c-769b-422a-9360-f9718251c524 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:39.812495 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1cecc02c-769b-422a-9360-f9718251c524 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:39.812949 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1cecc02c-769b-422a-9360-f9718251c524 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:39.813751 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1cecc02c-769b-422a-9360-f9718251c524 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:39.814189 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1cecc02c-769b-422a-9360-f9718251c524 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:39.838618 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-1cecc02c-769b-422a-9360-f9718251c524 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d/ips" status: 200 len: 149 microversion: 2.1 time: 0.038933 Jul 04 10:10:39.839205 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 124/246] 10.222.0.79 () {58 vars in 1247 bytes} [Mon Jul 4 10:10:39 2022] GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:10:39.925080 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-4c6101ae-f7d1-45ad-9ef7-f29ac35e7a33 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:39.925710 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-4c6101ae-f7d1-45ad-9ef7-f29ac35e7a33 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:39.932746 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-4c6101ae-f7d1-45ad-9ef7-f29ac35e7a33 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:39.933191 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-4c6101ae-f7d1-45ad-9ef7-f29ac35e7a33 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:39.934092 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-4c6101ae-f7d1-45ad-9ef7-f29ac35e7a33 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:39.934527 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-4c6101ae-f7d1-45ad-9ef7-f29ac35e7a33 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:40.104195 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-4c6101ae-f7d1-45ad-9ef7-f29ac35e7a33 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:40.113037 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-4c6101ae-f7d1-45ad-9ef7-f29ac35e7a33 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120" status: 200 len: 1521 microversion: 2.1 time: 0.192642 Jul 04 10:10:40.122894 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 123/247] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:39 2022] GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:40.199408 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-33fae628-d4fd-4fbd-837e-a2c71b69c9bf tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:40.200056 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-33fae628-d4fd-4fbd-837e-a2c71b69c9bf tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:40.207992 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-33fae628-d4fd-4fbd-837e-a2c71b69c9bf tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:40.208555 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-33fae628-d4fd-4fbd-837e-a2c71b69c9bf tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:40.209644 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-33fae628-d4fd-4fbd-837e-a2c71b69c9bf tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:40.210215 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-33fae628-d4fd-4fbd-837e-a2c71b69c9bf tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:40.240900 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-33fae628-d4fd-4fbd-837e-a2c71b69c9bf tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2/ips" status: 200 len: 149 microversion: 2.20 time: 0.045995 Jul 04 10:10:40.242404 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 125/248] 10.222.0.79 () {60 vars in 1288 bytes} [Mon Jul 4 10:10:40 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2/ips => generated 149 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 10:10:41.135042 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-195ab3d0-fa39-459b-8148-6b22f61874ad tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:41.135042 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-195ab3d0-fa39-459b-8148-6b22f61874ad tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:41.142318 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-195ab3d0-fa39-459b-8148-6b22f61874ad tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:41.143217 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-195ab3d0-fa39-459b-8148-6b22f61874ad tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:41.144087 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-195ab3d0-fa39-459b-8148-6b22f61874ad tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:41.146015 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-195ab3d0-fa39-459b-8148-6b22f61874ad tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:41.338543 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-195ab3d0-fa39-459b-8148-6b22f61874ad tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:41.340274 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f893cee4-d40a-4028-aa26-ef29046697a3 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17330f0e-d0ee-4eb0-a0a0-1258d7164424"}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:10:41.344768 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f893cee4-d40a-4028-aa26-ef29046697a3 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:41.349648 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-195ab3d0-fa39-459b-8148-6b22f61874ad tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120" status: 200 len: 1521 microversion: 2.1 time: 0.222531 Jul 04 10:10:41.350846 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 124/249] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:41 2022] GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:41.368391 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f893cee4-d40a-4028-aa26-ef29046697a3 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:41.370151 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f893cee4-d40a-4028-aa26-ef29046697a3 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:41.372716 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f893cee4-d40a-4028-aa26-ef29046697a3 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:41.374037 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f893cee4-d40a-4028-aa26-ef29046697a3 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:41.770752 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f893cee4-d40a-4028-aa26-ef29046697a3 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "POST /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.440013 Jul 04 10:10:41.771926 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 126/250] 10.222.0.79 () {60 vars in 1322 bytes} [Mon Jul 4 10:10:41 2022] POST /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d/os-volume_attachments => generated 194 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 10:10:42.367631 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-f7c75b0c-9e21-49e7-8525-f0e8b2dbf024 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:42.368890 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-f7c75b0c-9e21-49e7-8525-f0e8b2dbf024 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:42.374721 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_api:SELECT=38 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:42.377214 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f7c75b0c-9e21-49e7-8525-f0e8b2dbf024 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:42.377681 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f7c75b0c-9e21-49e7-8525-f0e8b2dbf024 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:42.378585 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f7c75b0c-9e21-49e7-8525-f0e8b2dbf024 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:42.379103 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f7c75b0c-9e21-49e7-8525-f0e8b2dbf024 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:42.536062 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-f7c75b0c-9e21-49e7-8525-f0e8b2dbf024 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:42.544965 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-f7c75b0c-9e21-49e7-8525-f0e8b2dbf024 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120" status: 200 len: 1521 microversion: 2.1 time: 0.181242 Jul 04 10:10:42.545961 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 125/251] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:42 2022] GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:42.849257 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b736bc24-b151-48d5-a1d7-2d89e37d246c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:10:42.850718 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-b736bc24-b151-48d5-a1d7-2d89e37d246c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:42.857660 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b736bc24-b151-48d5-a1d7-2d89e37d246c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:42.858314 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b736bc24-b151-48d5-a1d7-2d89e37d246c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:42.859094 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b736bc24-b151-48d5-a1d7-2d89e37d246c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:42.859528 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b736bc24-b151-48d5-a1d7-2d89e37d246c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:42.890883 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.objects.instance [None req-b736bc24-b151-48d5-a1d7-2d89e37d246c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lazy-loading 'flavor' on Instance uuid ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 {{(pid=117865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 10:10:43.319789 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-b736bc24-b151-48d5-a1d7-2d89e37d246c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "POST /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2/action" status: 202 len: 0 microversion: 2.20 time: 0.475329 Jul 04 10:10:43.320991 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 127/252] 10.222.0.79 () {62 vars in 1318 bytes} [Mon Jul 4 10:10:42 2022] POST /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 04 10:10:43.330669 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-39866f4a-e1ca-4fde-bb88-e454de154031 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:43.332301 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-39866f4a-e1ca-4fde-bb88-e454de154031 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:43.340973 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-39866f4a-e1ca-4fde-bb88-e454de154031 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:43.342633 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-39866f4a-e1ca-4fde-bb88-e454de154031 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:43.344498 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-39866f4a-e1ca-4fde-bb88-e454de154031 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:43.345205 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-39866f4a-e1ca-4fde-bb88-e454de154031 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:43.538070 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-39866f4a-e1ca-4fde-bb88-e454de154031 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:43.547670 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-39866f4a-e1ca-4fde-bb88-e454de154031 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:43.549506 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-39866f4a-e1ca-4fde-bb88-e454de154031 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:43.550901 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-39866f4a-e1ca-4fde-bb88-e454de154031 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1721 microversion: 2.20 time: 0.225552 Jul 04 10:10:43.552014 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 126/253] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:10:43 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:10:43.567775 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5a36ed23-d200-4752-b182-449f27ba6ce3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:43.568625 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-5a36ed23-d200-4752-b182-449f27ba6ce3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:43.579605 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5a36ed23-d200-4752-b182-449f27ba6ce3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:43.580051 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5a36ed23-d200-4752-b182-449f27ba6ce3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:43.580844 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5a36ed23-d200-4752-b182-449f27ba6ce3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:43.581272 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5a36ed23-d200-4752-b182-449f27ba6ce3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:43.796395 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-5a36ed23-d200-4752-b182-449f27ba6ce3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:43.805167 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-5a36ed23-d200-4752-b182-449f27ba6ce3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120" status: 200 len: 1521 microversion: 2.1 time: 0.245694 Jul 04 10:10:43.806586 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 128/254] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:43 2022] GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:44.581914 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-a9144142-0843-44a3-953b-4ddd3662815c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:44.583665 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-a9144142-0843-44a3-953b-4ddd3662815c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:44.597672 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a9144142-0843-44a3-953b-4ddd3662815c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:44.598814 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a9144142-0843-44a3-953b-4ddd3662815c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:44.600412 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a9144142-0843-44a3-953b-4ddd3662815c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:44.601316 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a9144142-0843-44a3-953b-4ddd3662815c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:44.823529 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-84f4573b-355c-45d1-880f-b094261351cc tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:44.824840 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-84f4573b-355c-45d1-880f-b094261351cc tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:44.868068 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-84f4573b-355c-45d1-880f-b094261351cc tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:44.868515 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-84f4573b-355c-45d1-880f-b094261351cc tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:44.869315 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-84f4573b-355c-45d1-880f-b094261351cc tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:44.869776 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-84f4573b-355c-45d1-880f-b094261351cc tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:44.873064 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:45.002621 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-a9144142-0843-44a3-953b-4ddd3662815c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:45.020482 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-a9144142-0843-44a3-953b-4ddd3662815c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:45.022191 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-a9144142-0843-44a3-953b-4ddd3662815c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:45.023352 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-a9144142-0843-44a3-953b-4ddd3662815c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1721 microversion: 2.20 time: 0.455824 Jul 04 10:10:45.024087 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 127/255] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:10:44 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1721 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:10:45.086977 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-84f4573b-355c-45d1-880f-b094261351cc tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:45.102260 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-84f4573b-355c-45d1-880f-b094261351cc tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120" status: 200 len: 1521 microversion: 2.1 time: 0.282749 Jul 04 10:10:45.111876 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 129/256] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:44 2022] GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120 => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:46.005814 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-12b5ee36-f992-4a39-8ac9-cc539a36d9f6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:10:46.015533 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-12b5ee36-f992-4a39-8ac9-cc539a36d9f6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:46.016147 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-12b5ee36-f992-4a39-8ac9-cc539a36d9f6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:46.048075 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-98a19e4e-73be-4375-bd57-03906cd5d7a0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:46.048930 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-98a19e4e-73be-4375-bd57-03906cd5d7a0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:46.056953 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-98a19e4e-73be-4375-bd57-03906cd5d7a0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:46.057654 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-98a19e4e-73be-4375-bd57-03906cd5d7a0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:46.058706 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-98a19e4e-73be-4375-bd57-03906cd5d7a0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:46.059205 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-98a19e4e-73be-4375-bd57-03906cd5d7a0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:46.088123 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-12b5ee36-f992-4a39-8ac9-cc539a36d9f6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Going to try to stop instance {{(pid=117866) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 04 10:10:46.104807 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:46.199035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-12b5ee36-f992-4a39-8ac9-cc539a36d9f6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "POST /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7/action" status: 202 len: 0 microversion: 2.1 time: 0.196794 Jul 04 10:10:46.199817 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 128/257] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Jul 4 10:10:45 2022] POST /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 10:10:46.221988 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-5179e41c-a0cb-4c53-b40a-17af3de23768 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:46.223096 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-5179e41c-a0cb-4c53-b40a-17af3de23768 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:46.231332 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5179e41c-a0cb-4c53-b40a-17af3de23768 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:46.232181 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5179e41c-a0cb-4c53-b40a-17af3de23768 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:46.233578 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5179e41c-a0cb-4c53-b40a-17af3de23768 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:46.234181 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5179e41c-a0cb-4c53-b40a-17af3de23768 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:46.253525 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-98a19e4e-73be-4375-bd57-03906cd5d7a0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:46.262455 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-98a19e4e-73be-4375-bd57-03906cd5d7a0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:46.265222 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-98a19e4e-73be-4375-bd57-03906cd5d7a0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:46.266607 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-98a19e4e-73be-4375-bd57-03906cd5d7a0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1721 microversion: 2.20 time: 0.228241 Jul 04 10:10:46.270124 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 130/258] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:10:46 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1721 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 10:10:46.277552 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5125de21-8ec3-40e0-ba23-4c057f607902 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:46.278284 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-5125de21-8ec3-40e0-ba23-4c057f607902 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:46.284482 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5125de21-8ec3-40e0-ba23-4c057f607902 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:46.285359 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5125de21-8ec3-40e0-ba23-4c057f607902 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:46.286295 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5125de21-8ec3-40e0-ba23-4c057f607902 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:46.286900 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5125de21-8ec3-40e0-ba23-4c057f607902 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:46.493116 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-5125de21-8ec3-40e0-ba23-4c057f607902 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:46.496838 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-5179e41c-a0cb-4c53-b40a-17af3de23768 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:46.506054 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-5179e41c-a0cb-4c53-b40a-17af3de23768 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120" status: 200 len: 1521 microversion: 2.1 time: 0.304386 Jul 04 10:10:46.506250 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-5125de21-8ec3-40e0-ba23-4c057f607902 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1723 microversion: 2.1 time: 0.230504 Jul 04 10:10:46.507212 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 129/259] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:46 2022] GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120 => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:46.507499 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 131/260] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:46 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:47.286422 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-64f93d5c-5040-47c7-8bd6-f955368de014 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:47.286978 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-64f93d5c-5040-47c7-8bd6-f955368de014 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:47.293718 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-64f93d5c-5040-47c7-8bd6-f955368de014 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:47.294323 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-64f93d5c-5040-47c7-8bd6-f955368de014 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:47.295132 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-64f93d5c-5040-47c7-8bd6-f955368de014 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:47.295560 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-64f93d5c-5040-47c7-8bd6-f955368de014 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:47.429701 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-64f93d5c-5040-47c7-8bd6-f955368de014 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:47.438155 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-64f93d5c-5040-47c7-8bd6-f955368de014 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:47.439655 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-64f93d5c-5040-47c7-8bd6-f955368de014 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:47.440841 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-64f93d5c-5040-47c7-8bd6-f955368de014 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1721 microversion: 2.20 time: 0.159189 Jul 04 10:10:47.441418 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 130/261] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:10:47 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:10:47.524375 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-4d001a12-7daa-497f-9924-2763d975e138 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:47.525085 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-4d001a12-7daa-497f-9924-2763d975e138 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:47.525921 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-8cef7372-9952-44e6-a22d-bf1105c8d5a6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:47.526498 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-8cef7372-9952-44e6-a22d-bf1105c8d5a6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:47.532407 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4d001a12-7daa-497f-9924-2763d975e138 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:47.532634 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8cef7372-9952-44e6-a22d-bf1105c8d5a6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:47.532934 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4d001a12-7daa-497f-9924-2763d975e138 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:47.533285 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8cef7372-9952-44e6-a22d-bf1105c8d5a6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:47.533720 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4d001a12-7daa-497f-9924-2763d975e138 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:47.534228 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8cef7372-9952-44e6-a22d-bf1105c8d5a6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:47.534481 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4d001a12-7daa-497f-9924-2763d975e138 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:47.534629 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8cef7372-9952-44e6-a22d-bf1105c8d5a6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:47.745229 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-4d001a12-7daa-497f-9924-2763d975e138 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:47.749036 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-8cef7372-9952-44e6-a22d-bf1105c8d5a6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:47.753654 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-4d001a12-7daa-497f-9924-2763d975e138 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120" status: 200 len: 1521 microversion: 2.1 time: 0.233366 Jul 04 10:10:47.754556 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 132/262] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:47 2022] GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:47.757807 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-8cef7372-9952-44e6-a22d-bf1105c8d5a6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1723 microversion: 2.1 time: 0.235986 Jul 04 10:10:47.758466 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 131/263] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:47 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:10:48.459736 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8a2fb925-eed3-4ca2-a5b0-5ea3a82d2464 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:48.460366 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-8a2fb925-eed3-4ca2-a5b0-5ea3a82d2464 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:48.466968 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8a2fb925-eed3-4ca2-a5b0-5ea3a82d2464 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:48.467191 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8a2fb925-eed3-4ca2-a5b0-5ea3a82d2464 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:48.467965 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8a2fb925-eed3-4ca2-a5b0-5ea3a82d2464 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:48.468755 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8a2fb925-eed3-4ca2-a5b0-5ea3a82d2464 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:48.627563 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-8a2fb925-eed3-4ca2-a5b0-5ea3a82d2464 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:48.637134 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-8a2fb925-eed3-4ca2-a5b0-5ea3a82d2464 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:48.638752 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-8a2fb925-eed3-4ca2-a5b0-5ea3a82d2464 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:48.640125 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-8a2fb925-eed3-4ca2-a5b0-5ea3a82d2464 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1721 microversion: 2.20 time: 0.184627 Jul 04 10:10:48.640840 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 133/264] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:10:48 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:10:48.772714 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-dd3d8233-f587-4514-b64b-15d0106603ff tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:48.773415 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-dd3d8233-f587-4514-b64b-15d0106603ff tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:48.776280 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-26f5c132-8785-485e-93e4-8ad783523027 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:48.777066 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-26f5c132-8785-485e-93e4-8ad783523027 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:48.779916 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-dd3d8233-f587-4514-b64b-15d0106603ff tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:48.780353 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-dd3d8233-f587-4514-b64b-15d0106603ff tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:48.781324 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-dd3d8233-f587-4514-b64b-15d0106603ff tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:48.781791 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-dd3d8233-f587-4514-b64b-15d0106603ff tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:48.783858 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-26f5c132-8785-485e-93e4-8ad783523027 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:48.784310 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-26f5c132-8785-485e-93e4-8ad783523027 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:48.785073 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-26f5c132-8785-485e-93e4-8ad783523027 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:48.787626 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-26f5c132-8785-485e-93e4-8ad783523027 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:49.016623 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-dd3d8233-f587-4514-b64b-15d0106603ff tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:49.026085 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-dd3d8233-f587-4514-b64b-15d0106603ff tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120" status: 200 len: 1521 microversion: 2.1 time: 0.258328 Jul 04 10:10:49.027219 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 132/265] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:48 2022] GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:49.053130 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-26f5c132-8785-485e-93e4-8ad783523027 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:49.062695 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-26f5c132-8785-485e-93e4-8ad783523027 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1723 microversion: 2.1 time: 0.290670 Jul 04 10:10:49.063337 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 134/266] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:48 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1723 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:49.660052 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-e79dc867-7953-48fc-bdc2-35d27c64cb06 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:49.660791 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-e79dc867-7953-48fc-bdc2-35d27c64cb06 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:49.666915 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e79dc867-7953-48fc-bdc2-35d27c64cb06 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:49.667619 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e79dc867-7953-48fc-bdc2-35d27c64cb06 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:49.668409 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e79dc867-7953-48fc-bdc2-35d27c64cb06 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:49.668954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e79dc867-7953-48fc-bdc2-35d27c64cb06 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:49.801821 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-e79dc867-7953-48fc-bdc2-35d27c64cb06 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:49.809984 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-e79dc867-7953-48fc-bdc2-35d27c64cb06 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:49.811636 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-e79dc867-7953-48fc-bdc2-35d27c64cb06 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:49.812945 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-e79dc867-7953-48fc-bdc2-35d27c64cb06 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1721 microversion: 2.20 time: 0.156781 Jul 04 10:10:49.813666 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 133/267] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:10:49 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:10:50.043931 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2cfe7f3d-be8f-4d3d-87c4-d7fa613a206a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:50.044647 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-2cfe7f3d-be8f-4d3d-87c4-d7fa613a206a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:50.051333 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2cfe7f3d-be8f-4d3d-87c4-d7fa613a206a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:50.051702 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2cfe7f3d-be8f-4d3d-87c4-d7fa613a206a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:50.052453 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2cfe7f3d-be8f-4d3d-87c4-d7fa613a206a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:50.052926 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2cfe7f3d-be8f-4d3d-87c4-d7fa613a206a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:50.082320 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-ea341e71-938b-4452-bc56-b99ac03a4ec6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:50.083306 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-ea341e71-938b-4452-bc56-b99ac03a4ec6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:50.090247 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ea341e71-938b-4452-bc56-b99ac03a4ec6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:50.090878 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ea341e71-938b-4452-bc56-b99ac03a4ec6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:50.091915 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ea341e71-938b-4452-bc56-b99ac03a4ec6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:50.092858 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ea341e71-938b-4452-bc56-b99ac03a4ec6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:50.343725 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-2cfe7f3d-be8f-4d3d-87c4-d7fa613a206a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:50.351979 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-2cfe7f3d-be8f-4d3d-87c4-d7fa613a206a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120" status: 200 len: 1521 microversion: 2.1 time: 0.312036 Jul 04 10:10:50.352537 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 135/268] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:50 2022] GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120 => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:50.362947 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-ea341e71-938b-4452-bc56-b99ac03a4ec6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:50.372510 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-ea341e71-938b-4452-bc56-b99ac03a4ec6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1723 microversion: 2.1 time: 0.296147 Jul 04 10:10:50.382501 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 134/269] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:50 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1723 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:10:50.840000 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5d32e172-a034-4a89-8c8d-1ef38b518dc7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:50.840000 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-5d32e172-a034-4a89-8c8d-1ef38b518dc7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:50.842171 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5d32e172-a034-4a89-8c8d-1ef38b518dc7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:50.842667 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5d32e172-a034-4a89-8c8d-1ef38b518dc7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:50.843799 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5d32e172-a034-4a89-8c8d-1ef38b518dc7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:50.844370 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5d32e172-a034-4a89-8c8d-1ef38b518dc7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:51.051355 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-5d32e172-a034-4a89-8c8d-1ef38b518dc7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:51.060131 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-5d32e172-a034-4a89-8c8d-1ef38b518dc7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:51.061836 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-5d32e172-a034-4a89-8c8d-1ef38b518dc7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:51.063002 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-5d32e172-a034-4a89-8c8d-1ef38b518dc7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1721 microversion: 2.20 time: 0.235213 Jul 04 10:10:51.063536 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 136/270] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:10:50 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1721 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:10:51.370110 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-92d270d9-724e-4a93-b0ac-421e8f66c8b0 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:51.370716 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-92d270d9-724e-4a93-b0ac-421e8f66c8b0 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:51.379003 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-92d270d9-724e-4a93-b0ac-421e8f66c8b0 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:51.379763 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-92d270d9-724e-4a93-b0ac-421e8f66c8b0 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:51.380541 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-92d270d9-724e-4a93-b0ac-421e8f66c8b0 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:51.380968 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-92d270d9-724e-4a93-b0ac-421e8f66c8b0 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:51.390708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-451d248e-50fb-4d04-8adf-3b74b8b03802 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:51.392138 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-451d248e-50fb-4d04-8adf-3b74b8b03802 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:51.400825 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-451d248e-50fb-4d04-8adf-3b74b8b03802 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:51.401735 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-451d248e-50fb-4d04-8adf-3b74b8b03802 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:51.403148 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-451d248e-50fb-4d04-8adf-3b74b8b03802 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:51.403996 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-451d248e-50fb-4d04-8adf-3b74b8b03802 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:51.640898 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-92d270d9-724e-4a93-b0ac-421e8f66c8b0 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:51.654240 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-92d270d9-724e-4a93-b0ac-421e8f66c8b0 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120" status: 200 len: 1501 microversion: 2.1 time: 0.285462 Jul 04 10:10:51.654787 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-451d248e-50fb-4d04-8adf-3b74b8b03802 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:51.655010 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 135/271] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:51 2022] GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120 => generated 1501 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:51.674662 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-3363fc8b-c9f4-4f81-b1e1-06415d7e9385 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e42b4063-281f-4d0d-b6e8-f7a5050b528f"}} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:10:51.675796 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-451d248e-50fb-4d04-8adf-3b74b8b03802 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1723 microversion: 2.1 time: 0.289427 Jul 04 10:10:51.675924 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-3363fc8b-c9f4-4f81-b1e1-06415d7e9385 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:51.676444 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 137/272] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:51 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:51.682546 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3363fc8b-c9f4-4f81-b1e1-06415d7e9385 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:51.682982 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3363fc8b-c9f4-4f81-b1e1-06415d7e9385 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:51.683798 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3363fc8b-c9f4-4f81-b1e1-06415d7e9385 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:51.684482 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3363fc8b-c9f4-4f81-b1e1-06415d7e9385 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:51.710377 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.wsgi [None req-3363fc8b-c9f4-4f81-b1e1-06415d7e9385 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] HTTP exception thrown: Cannot 'attach_volume' instance 068a560b-f200-4046-a36b-7ef23cea5120 while it is in vm_state rescued Jul 04 10:10:51.714801 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-3363fc8b-c9f4-4f81-b1e1-06415d7e9385 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Request method failure captured: Jul 04 10:10:51.714801 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: request: POST /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120/os-volume_attachments HTTP/1.1 Jul 04 10:10:51.714801 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept: application/json Jul 04 10:10:51.714801 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept-Encoding: identity Jul 04 10:10:51.714801 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Connection: close Jul 04 10:10:51.714801 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Length: 74 Jul 04 10:10:51.714801 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Type: application/json Jul 04 10:10:51.714801 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Host: 10.222.0.79 Jul 04 10:10:51.714801 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Openstack-System-Scope: None Jul 04 10:10:51.714801 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: User-Agent: python-urllib3/1.26.9 Jul 04 10:10:51.714801 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Auth-Token: gAAAAABiwrwoMkd-FZrLDL5-aiRWEi2tqP5Y9aVcYuzksosW1VeQBqKJ-M1OWBbervr9826WxI3yk8EyOa512EHvhSat68LXFU2P2jP3EEjFTBdF0aQwIXnaeXxxjkpaGKt1qebXvZBxiG3u8qxwquzbjrAQDdrYWk79BjtmAHI2EEpansDRzwg Jul 04 10:10:51.714801 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Id: None Jul 04 10:10:51.714801 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Name: None Jul 04 10:10:51.714801 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Identity-Status: Confirmed Jul 04 10:10:51.714801 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Is-Admin-Project: True Jul 04 10:10:51.714801 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Id: default Jul 04 10:10:51.714801 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Name: Default Jul 04 10:10:51.714801 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Id: 7f101e48ae9b4936a6d1b7bae000d7e1 Jul 04 10:10:51.714801 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1112364786 Jul 04 10:10:51.714801 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Role: reader,member Jul 04 10:10:51.714801 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Roles: reader,member Jul 04 10:10:51.716224 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7f101e48ae9b4936a6d1b7bae000d7e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7f101e48ae9b4936a6d1b7bae000d7e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7f101e48ae9b4936a6d1b7bae000d7e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7f101e48ae9b4936a6d1b7bae000d7e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:10:51.716224 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1112364786 Jul 04 10:10:51.716224 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Id: 7f101e48ae9b4936a6d1b7bae000d7e1 Jul 04 10:10:51.716224 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1112364786 Jul 04 10:10:51.716224 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User: tempest-ServerRescueNegativeTestJSON-1112364786-project Jul 04 10:10:51.716224 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Id: default Jul 04 10:10:51.716224 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Name: Default Jul 04 10:10:51.716224 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Id: fc9c26318d6c41f6b9455153f0d0e55b Jul 04 10:10:51.716224 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1112364786-project Jul 04 10:10:51.716224 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Jul 04 10:10:51.716224 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {"volumeAttachment": {"volumeId": "e42b4063-281f-4d0d-b6e8-f7a5050b528f"}} Jul 04 10:10:51.716224 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: method: > Jul 04 10:10:51.717011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: exception: Cannot 'attach_volume' instance 068a560b-f200-4046-a36b-7ef23cea5120 while it is in vm_state rescued Jul 04 10:10:51.717011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: action_args: {'server_id': '068a560b-f200-4046-a36b-7ef23cea5120', 'body': {'volumeAttachment': {'volumeId': 'e42b4063-281f-4d0d-b6e8-f7a5050b528f'}}} Jul 04 10:10:51.717011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:10:51.717011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:10:51.717011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 04 10:10:51.717011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 04 10:10:51.717011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 04 10:10:51.717011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 04 10:10:51.717011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 04 10:10:51.717011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 04 10:10:51.717011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 068a560b-f200-4046-a36b-7ef23cea5120 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 04 10:10:51.717011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:10:51.717011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:10:51.717011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:10:51.717011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:10:51.717011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:10:51.717011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:10:51.717011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:10:51.717011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:10:51.718113 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:10:51.718113 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:10:51.718113 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 10:10:51.718113 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 10:10:51.718113 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 10:10:51.718113 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 10:10:51.718113 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 10:10:51.718113 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 10:10:51.718113 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 04 10:10:51.718113 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 04 10:10:51.718113 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 04 10:10:51.718113 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 04 10:10:51.718113 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 068a560b-f200-4046-a36b-7ef23cea5120 while it is in vm_state rescued Jul 04 10:10:51.718113 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:10:51.718113 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:10:51.718113 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:10:51.718113 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:10:51.718113 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:10:51.718113 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:10:51.719441 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:10:51.719441 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:10:51.719441 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 068a560b-f200-4046-a36b-7ef23cea5120 while it is in vm_state rescued Jul 04 10:10:51.719441 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:10:51.719441 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-3363fc8b-c9f4-4f81-b1e1-06415d7e9385 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Returning 409 to user: Cannot 'attach_volume' instance 068a560b-f200-4046-a36b-7ef23cea5120 while it is in vm_state rescued {{(pid=117866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:10:51.720413 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-3363fc8b-c9f4-4f81-b1e1-06415d7e9385 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "POST /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.049942 Jul 04 10:10:51.722140 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 136/273] 10.222.0.79 () {60 vars in 1322 bytes} [Mon Jul 4 10:10:51 2022] POST /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120/os-volume_attachments => generated 152 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 04 10:10:51.730793 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-7575afe1-f2c8-4374-8389-78e7a370fa89 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:10:51.731321 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-7575afe1-f2c8-4374-8389-78e7a370fa89 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:51.738041 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7575afe1-f2c8-4374-8389-78e7a370fa89 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:51.738482 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7575afe1-f2c8-4374-8389-78e7a370fa89 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:51.739251 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7575afe1-f2c8-4374-8389-78e7a370fa89 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:51.739839 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7575afe1-f2c8-4374-8389-78e7a370fa89 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:51.835185 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-7575afe1-f2c8-4374-8389-78e7a370fa89 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "POST /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120/action" status: 202 len: 0 microversion: 2.1 time: 0.108136 Jul 04 10:10:51.836061 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 138/274] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Jul 4 10:10:51 2022] POST /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 10:10:51.847055 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-8660f254-8fdc-46e5-ba06-531c2b94c73a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:51.848497 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-8660f254-8fdc-46e5-ba06-531c2b94c73a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:51.867838 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8660f254-8fdc-46e5-ba06-531c2b94c73a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:51.869111 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8660f254-8fdc-46e5-ba06-531c2b94c73a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:51.871486 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8660f254-8fdc-46e5-ba06-531c2b94c73a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:51.871943 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8660f254-8fdc-46e5-ba06-531c2b94c73a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:52.075599 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-8660f254-8fdc-46e5-ba06-531c2b94c73a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:52.080832 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-c3d8d829-d537-45e7-817c-b659ceca4374 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:52.081527 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-c3d8d829-d537-45e7-817c-b659ceca4374 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:52.084245 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-8660f254-8fdc-46e5-ba06-531c2b94c73a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120" status: 200 len: 1509 microversion: 2.1 time: 0.243831 Jul 04 10:10:52.085249 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 137/275] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:51 2022] GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120 => generated 1509 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:52.088319 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c3d8d829-d537-45e7-817c-b659ceca4374 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:52.088984 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c3d8d829-d537-45e7-817c-b659ceca4374 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:52.089979 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c3d8d829-d537-45e7-817c-b659ceca4374 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:52.090579 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c3d8d829-d537-45e7-817c-b659ceca4374 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:52.242535 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-c3d8d829-d537-45e7-817c-b659ceca4374 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:52.252005 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-c3d8d829-d537-45e7-817c-b659ceca4374 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:52.253888 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-c3d8d829-d537-45e7-817c-b659ceca4374 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:52.255270 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-c3d8d829-d537-45e7-817c-b659ceca4374 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1721 microversion: 2.20 time: 0.178725 Jul 04 10:10:52.256070 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 139/276] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:10:52 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 10:10:52.689897 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-f4e54563-e2c9-4c2f-9d8c-0a5541fd7d72 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Action: 'create', calling method: .version_select at 0x7f2808222700>, body: {"keypair": {"name": "tempest-keypair-1928640362", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFEFu6R5BWGvfujzq5v+odw9hyX5ZwKv5U7qIkN/K24CyFQrcxr2ApfRbBjqwoHUmXJynpijcBLUCEWhLHWztl58/SZrDU18xRFY6pepei1YQ++r/n4vUEjZaUN7uNATw=="}} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:10:52.694906 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-a52308a1-ec61-4fdb-938d-a14b08b871bb tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:52.696134 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-a52308a1-ec61-4fdb-938d-a14b08b871bb tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:52.707565 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a52308a1-ec61-4fdb-938d-a14b08b871bb tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:52.710044 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a52308a1-ec61-4fdb-938d-a14b08b871bb tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:52.711692 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a52308a1-ec61-4fdb-938d-a14b08b871bb tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:52.712136 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a52308a1-ec61-4fdb-938d-a14b08b871bb tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:52.728927 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.quota [None req-f4e54563-e2c9-4c2f-9d8c-0a5541fd7d72 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Getting quotas for project a57f93d66f534107a228d908afa64890. Resources: {'key_pairs'} {{(pid=117866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 10:10:52.733595 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.quota [None req-f4e54563-e2c9-4c2f-9d8c-0a5541fd7d72 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Getting quotas for user 88d2351fc3b74ef5a530fded1be6b997 and project a57f93d66f534107a228d908afa64890. Resources: {'key_pairs'} {{(pid=117866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 10:10:52.764114 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-f4e54563-e2c9-4c2f-9d8c-0a5541fd7d72 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.078454 Jul 04 10:10:52.766071 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 138/277] 10.222.0.79 () {60 vars in 1158 bytes} [Mon Jul 4 10:10:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:10:52.870723 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-a52308a1-ec61-4fdb-938d-a14b08b871bb tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:52.882090 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-a52308a1-ec61-4fdb-938d-a14b08b871bb tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1723 microversion: 2.1 time: 0.192802 Jul 04 10:10:52.882633 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 140/278] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:52 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:10:53.102035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-08b7093f-5b1a-4f81-af1b-1e0156bc5146 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:53.102641 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-08b7093f-5b1a-4f81-af1b-1e0156bc5146 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:53.108796 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-08b7093f-5b1a-4f81-af1b-1e0156bc5146 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:53.109239 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-08b7093f-5b1a-4f81-af1b-1e0156bc5146 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:53.110034 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-08b7093f-5b1a-4f81-af1b-1e0156bc5146 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:53.110464 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-08b7093f-5b1a-4f81-af1b-1e0156bc5146 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:53.274283 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f3faaaf7-51a1-47d3-a771-a65cab484cb1 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:53.275523 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f3faaaf7-51a1-47d3-a771-a65cab484cb1 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:53.283293 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f3faaaf7-51a1-47d3-a771-a65cab484cb1 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:53.283737 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f3faaaf7-51a1-47d3-a771-a65cab484cb1 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:53.284509 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f3faaaf7-51a1-47d3-a771-a65cab484cb1 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:53.284936 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f3faaaf7-51a1-47d3-a771-a65cab484cb1 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:53.563147 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-f3faaaf7-51a1-47d3-a771-a65cab484cb1 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:53.571736 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-f3faaaf7-51a1-47d3-a771-a65cab484cb1 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:53.573391 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-f3faaaf7-51a1-47d3-a771-a65cab484cb1 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:53.574692 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f3faaaf7-51a1-47d3-a771-a65cab484cb1 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1721 microversion: 2.20 time: 0.304408 Jul 04 10:10:53.578714 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-08b7093f-5b1a-4f81-af1b-1e0156bc5146 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:53.586374 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 141/279] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:10:53 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1721 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 10:10:53.592669 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-08b7093f-5b1a-4f81-af1b-1e0156bc5146 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120" status: 200 len: 1509 microversion: 2.1 time: 0.494241 Jul 04 10:10:53.594312 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 139/280] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:53 2022] GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120 => generated 1509 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:53.899950 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2f6b3f0d-2ebe-4899-8364-23e3cccd2ae4 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:53.900578 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-2f6b3f0d-2ebe-4899-8364-23e3cccd2ae4 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:53.907449 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2f6b3f0d-2ebe-4899-8364-23e3cccd2ae4 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:53.907911 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2f6b3f0d-2ebe-4899-8364-23e3cccd2ae4 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:53.908665 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2f6b3f0d-2ebe-4899-8364-23e3cccd2ae4 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:53.909094 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2f6b3f0d-2ebe-4899-8364-23e3cccd2ae4 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:54.050161 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-2f6b3f0d-2ebe-4899-8364-23e3cccd2ae4 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:54.062472 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-2f6b3f0d-2ebe-4899-8364-23e3cccd2ae4 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1723 microversion: 2.1 time: 0.166391 Jul 04 10:10:54.063199 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 142/281] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:53 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:54.514101 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-2d3f9e66-eda9-42e0-b686-47eb455852b0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2088123438", "imageRef": "80bd29b0-b77c-4611-be31-69ca559a2d2a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3ebecf3d-37d9-4ade-a898-e313cec92aef"}], "security_groups": [{"name": "tempest-securitygroup--1104434129"}], "key_name": "tempest-keypair-1928640362", "user_data": "}} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:10:54.594294 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-c6e8230a-8847-4623-aaa6-0cf4646b2955 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:54.594992 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-c6e8230a-8847-4623-aaa6-0cf4646b2955 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:54.603158 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c6e8230a-8847-4623-aaa6-0cf4646b2955 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:54.603608 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c6e8230a-8847-4623-aaa6-0cf4646b2955 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:54.605075 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c6e8230a-8847-4623-aaa6-0cf4646b2955 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:54.605605 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c6e8230a-8847-4623-aaa6-0cf4646b2955 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:54.654275 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.network.neutron [None req-2d3f9e66-eda9-42e0-b686-47eb455852b0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] validate_networks() for [('3ebecf3d-37d9-4ade-a898-e313cec92aef', None, None, None, None, None)] {{(pid=117866) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 10:10:54.824689 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-c6e8230a-8847-4623-aaa6-0cf4646b2955 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:54.834370 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-c6e8230a-8847-4623-aaa6-0cf4646b2955 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:54.835856 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-c6e8230a-8847-4623-aaa6-0cf4646b2955 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:54.837001 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-c6e8230a-8847-4623-aaa6-0cf4646b2955 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1721 microversion: 2.20 time: 0.247999 Jul 04 10:10:54.837575 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 143/282] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:10:54 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1721 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 10:10:54.841949 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-abc4b497-35e8-43b8-a518-314daa7d6696 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:54.842755 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-abc4b497-35e8-43b8-a518-314daa7d6696 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:54.849400 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-abc4b497-35e8-43b8-a518-314daa7d6696 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:54.849878 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-abc4b497-35e8-43b8-a518-314daa7d6696 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:54.850646 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-abc4b497-35e8-43b8-a518-314daa7d6696 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:54.851038 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-abc4b497-35e8-43b8-a518-314daa7d6696 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:55.054646 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-abc4b497-35e8-43b8-a518-314daa7d6696 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:55.057248 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:55.065757 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-abc4b497-35e8-43b8-a518-314daa7d6696 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120" status: 200 len: 1515 microversion: 2.1 time: 0.226918 Jul 04 10:10:55.067179 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 144/283] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:54 2022] GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120 => generated 1515 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:55.080782 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-fe1fb84b-f4bf-46af-92bb-a4c8cc2c4d4e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:55.081381 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-fe1fb84b-f4bf-46af-92bb-a4c8cc2c4d4e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:55.099017 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fe1fb84b-f4bf-46af-92bb-a4c8cc2c4d4e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:55.099463 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fe1fb84b-f4bf-46af-92bb-a4c8cc2c4d4e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:55.100236 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fe1fb84b-f4bf-46af-92bb-a4c8cc2c4d4e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:55.100664 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fe1fb84b-f4bf-46af-92bb-a4c8cc2c4d4e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:55.227110 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-2d3f9e66-eda9-42e0-b686-47eb455852b0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Flavor limits 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 10:10:55.227521 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-2d3f9e66-eda9-42e0-b686-47eb455852b0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Image limits 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 10:10:55.228033 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-2d3f9e66-eda9-42e0-b686-47eb455852b0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Flavor pref 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 10:10:55.228457 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-2d3f9e66-eda9-42e0-b686-47eb455852b0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Image pref 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 10:10:55.229288 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-2d3f9e66-eda9-42e0-b686-47eb455852b0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 10:10:55.241318 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2d3f9e66-eda9-42e0-b686-47eb455852b0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:55.241789 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2d3f9e66-eda9-42e0-b686-47eb455852b0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:55.242597 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2d3f9e66-eda9-42e0-b686-47eb455852b0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:55.243228 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2d3f9e66-eda9-42e0-b686-47eb455852b0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:55.262045 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.quota [None req-2d3f9e66-eda9-42e0-b686-47eb455852b0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Getting quotas for project a57f93d66f534107a228d908afa64890. Resources: {'cores', 'ram', 'instances'} {{(pid=117866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 10:10:55.266336 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.quota [None req-2d3f9e66-eda9-42e0-b686-47eb455852b0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Getting quotas for user 88d2351fc3b74ef5a530fded1be6b997 and project a57f93d66f534107a228d908afa64890. Resources: {'cores', 'ram', 'instances'} {{(pid=117866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 10:10:55.277721 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-2d3f9e66-eda9-42e0-b686-47eb455852b0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Going to run 1 instances... {{(pid=117866) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 10:10:55.280126 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-2d3f9e66-eda9-42e0-b686-47eb455852b0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 13a952ca-c64f-4b22-89d3-3911935ee74d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80bd29b0-b77c-4611-be31-69ca559a2d2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 10:10:55.291125 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-fe1fb84b-f4bf-46af-92bb-a4c8cc2c4d4e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:55.302781 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-fe1fb84b-f4bf-46af-92bb-a4c8cc2c4d4e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1723 microversion: 2.1 time: 0.226256 Jul 04 10:10:55.303592 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 145/284] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:55 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:55.334603 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-2d3f9e66-eda9-42e0-b686-47eb455852b0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.825109 Jul 04 10:10:55.335254 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 140/285] 10.222.0.79 () {60 vars in 1146 bytes} [Mon Jul 4 10:10:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 10:10:55.346558 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-cbabc74c-77bf-45a2-822d-58c237ac2d85 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:55.347510 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-cbabc74c-77bf-45a2-822d-58c237ac2d85 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 13a952ca-c64f-4b22-89d3-3911935ee74d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:55.426425 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-cbabc74c-77bf-45a2-822d-58c237ac2d85 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:55.440326 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-cbabc74c-77bf-45a2-822d-58c237ac2d85 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d" status: 200 len: 1242 microversion: 2.1 time: 0.098458 Jul 04 10:10:55.440991 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 146/286] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:55 2022] GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d => generated 1242 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:55.857250 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-78201d9e-20c1-4391-84e6-072c56ea6f38 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:55.857250 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-78201d9e-20c1-4391-84e6-072c56ea6f38 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:55.865812 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-78201d9e-20c1-4391-84e6-072c56ea6f38 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:55.866591 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-78201d9e-20c1-4391-84e6-072c56ea6f38 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:55.867641 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-78201d9e-20c1-4391-84e6-072c56ea6f38 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:55.868290 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-78201d9e-20c1-4391-84e6-072c56ea6f38 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:56.034926 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-78201d9e-20c1-4391-84e6-072c56ea6f38 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:56.043551 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-78201d9e-20c1-4391-84e6-072c56ea6f38 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:56.045119 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-78201d9e-20c1-4391-84e6-072c56ea6f38 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:56.046323 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-78201d9e-20c1-4391-84e6-072c56ea6f38 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1721 microversion: 2.20 time: 0.193959 Jul 04 10:10:56.046893 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 141/287] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:10:55 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:10:56.320794 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-1aed7b62-0953-42f0-96a0-00ab32d6ebbc tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:56.321361 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-1aed7b62-0953-42f0-96a0-00ab32d6ebbc tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:56.328439 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1aed7b62-0953-42f0-96a0-00ab32d6ebbc tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:56.328849 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1aed7b62-0953-42f0-96a0-00ab32d6ebbc tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:56.329611 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1aed7b62-0953-42f0-96a0-00ab32d6ebbc tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:56.330066 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1aed7b62-0953-42f0-96a0-00ab32d6ebbc tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:56.456638 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-73a560d3-c92e-469a-8c5d-cb731016d9a3 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:56.457215 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-73a560d3-c92e-469a-8c5d-cb731016d9a3 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 13a952ca-c64f-4b22-89d3-3911935ee74d] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:56.469944 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-73a560d3-c92e-469a-8c5d-cb731016d9a3 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:56.469944 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-73a560d3-c92e-469a-8c5d-cb731016d9a3 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:56.469944 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-73a560d3-c92e-469a-8c5d-cb731016d9a3 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:56.469944 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-73a560d3-c92e-469a-8c5d-cb731016d9a3 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:56.470271 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-1aed7b62-0953-42f0-96a0-00ab32d6ebbc tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:56.482118 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-1aed7b62-0953-42f0-96a0-00ab32d6ebbc tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1723 microversion: 2.1 time: 0.165088 Jul 04 10:10:56.483229 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 147/288] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:56 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:56.488043 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2b6195d4-5c4d-464a-b586-c47ce7a6040e tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Action: 'create', calling method: .version_select at 0x7f28081a7af0>, body: {"keypair": {"name": "tempest-keypair-2115852548", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJ7rF9XH20CvBkCvXMpa3oh3/XMLYP/CLcD6a+jDVzE/p4fOcQQHInDajHYtY9dBZVzHHrIvUUYgxSGeqGZC+R2D06Gaqhce45nfx+DbxMf2h1LKb+aHxuKBsGb3sS58w=="}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:10:56.507874 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-2b6195d4-5c4d-464a-b586-c47ce7a6040e tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Getting quotas for project 7f101e48ae9b4936a6d1b7bae000d7e1. Resources: {'key_pairs'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 10:10:56.513986 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-2b6195d4-5c4d-464a-b586-c47ce7a6040e tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Getting quotas for user fc9c26318d6c41f6b9455153f0d0e55b and project 7f101e48ae9b4936a6d1b7bae000d7e1. Resources: {'key_pairs'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 10:10:56.531018 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-73a560d3-c92e-469a-8c5d-cb731016d9a3 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:56.541203 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-2b6195d4-5c4d-464a-b586-c47ce7a6040e tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056219 Jul 04 10:10:56.543376 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 148/289] 10.222.0.79 () {60 vars in 1158 bytes} [Mon Jul 4 10:10:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:10:56.544294 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-73a560d3-c92e-469a-8c5d-cb731016d9a3 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d" status: 200 len: 1302 microversion: 2.1 time: 0.091234 Jul 04 10:10:56.553864 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 142/290] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:56 2022] GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d => generated 1302 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:10:57.066629 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5b0cabb8-0b49-4442-8078-f1d4cec370f1 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:57.067497 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-5b0cabb8-0b49-4442-8078-f1d4cec370f1 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:57.073973 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5b0cabb8-0b49-4442-8078-f1d4cec370f1 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:57.074503 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5b0cabb8-0b49-4442-8078-f1d4cec370f1 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:57.075418 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5b0cabb8-0b49-4442-8078-f1d4cec370f1 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:57.076156 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5b0cabb8-0b49-4442-8078-f1d4cec370f1 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:57.361935 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-5b0cabb8-0b49-4442-8078-f1d4cec370f1 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:57.372320 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-5b0cabb8-0b49-4442-8078-f1d4cec370f1 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:57.375253 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-5b0cabb8-0b49-4442-8078-f1d4cec370f1 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:57.377021 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-5b0cabb8-0b49-4442-8078-f1d4cec370f1 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1721 microversion: 2.20 time: 0.315961 Jul 04 10:10:57.378228 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 149/291] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:10:57 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1721 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:10:57.500369 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-7c7db588-bfd5-4c06-9928-c5b88e947d5e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:57.501012 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-7c7db588-bfd5-4c06-9928-c5b88e947d5e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:57.509302 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7c7db588-bfd5-4c06-9928-c5b88e947d5e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:57.509798 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7c7db588-bfd5-4c06-9928-c5b88e947d5e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:57.510593 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7c7db588-bfd5-4c06-9928-c5b88e947d5e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:57.515894 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7c7db588-bfd5-4c06-9928-c5b88e947d5e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:57.561828 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-62f6f2f0-695b-4ed1-9d81-867bad4bb485 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:57.562864 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-62f6f2f0-695b-4ed1-9d81-867bad4bb485 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 13a952ca-c64f-4b22-89d3-3911935ee74d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:57.573263 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-62f6f2f0-695b-4ed1-9d81-867bad4bb485 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:57.575213 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-62f6f2f0-695b-4ed1-9d81-867bad4bb485 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:57.576755 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-62f6f2f0-695b-4ed1-9d81-867bad4bb485 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:57.577944 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-62f6f2f0-695b-4ed1-9d81-867bad4bb485 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:57.815791 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-7c7db588-bfd5-4c06-9928-c5b88e947d5e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:57.836839 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-7c7db588-bfd5-4c06-9928-c5b88e947d5e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1723 microversion: 2.1 time: 0.331987 Jul 04 10:10:57.845956 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 143/292] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:57 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1723 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:57.871642 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-62f6f2f0-695b-4ed1-9d81-867bad4bb485 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:57.880958 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-62f6f2f0-695b-4ed1-9d81-867bad4bb485 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d" status: 200 len: 1368 microversion: 2.1 time: 0.324127 Jul 04 10:10:57.882256 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 150/293] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:57 2022] GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d => generated 1368 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:58.316499 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-e9ad40a3-8913-486e-8520-5b2ba7e5e297 req-5e68d7ed-b429-48d6-84b8-498a27c0ca15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13a952ca-c64f-4b22-89d3-3911935ee74d", "tag": "391d4036-90c2-4805-86d2-58d8be59784d"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:10:58.334092 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-6ddf38de-4a6c-4d8a-a190-7eca73cdfd3a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-313299156", "imageRef": "80bd29b0-b77c-4611-be31-69ca559a2d2a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ca42d015-9cb6-4405-9736-f11c22ec9001"}], "security_groups": [{"name": "tempest-securitygroup--1131359773"}], "key_name": "tempest-keypair-2115852548", "user_data": "}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:10:58.339121 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-e9ad40a3-8913-486e-8520-5b2ba7e5e297 req-5e68d7ed-b429-48d6-84b8-498a27c0ca15 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:58.339558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-e9ad40a3-8913-486e-8520-5b2ba7e5e297 req-5e68d7ed-b429-48d6-84b8-498a27c0ca15 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:58.373598 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-e9ad40a3-8913-486e-8520-5b2ba7e5e297 req-5e68d7ed-b429-48d6-84b8-498a27c0ca15 service nova] Creating event network-changed:391d4036-90c2-4805-86d2-58d8be59784d for instance 13a952ca-c64f-4b22-89d3-3911935ee74d on hv-cinder-84841 Jul 04 10:10:58.379245 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-e9ad40a3-8913-486e-8520-5b2ba7e5e297 req-5e68d7ed-b429-48d6-84b8-498a27c0ca15 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071537 Jul 04 10:10:58.382775 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 144/294] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:10:58.401435 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-b6f14d75-f446-4248-b659-2d0204c896a3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:58.403655 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-b6f14d75-f446-4248-b659-2d0204c896a3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:58.411492 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b6f14d75-f446-4248-b659-2d0204c896a3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:58.412181 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b6f14d75-f446-4248-b659-2d0204c896a3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:58.413201 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b6f14d75-f446-4248-b659-2d0204c896a3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:58.413934 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b6f14d75-f446-4248-b659-2d0204c896a3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:58.524667 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.network.neutron [None req-6ddf38de-4a6c-4d8a-a190-7eca73cdfd3a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] validate_networks() for [('ca42d015-9cb6-4405-9736-f11c22ec9001', None, None, None, None, None)] {{(pid=117865) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 10:10:58.691424 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-b6f14d75-f446-4248-b659-2d0204c896a3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:58.700771 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-b6f14d75-f446-4248-b659-2d0204c896a3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:58.712560 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-b6f14d75-f446-4248-b659-2d0204c896a3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:58.713996 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-b6f14d75-f446-4248-b659-2d0204c896a3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1721 microversion: 2.20 time: 0.317118 Jul 04 10:10:58.725396 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 145/295] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:10:58 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1721 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:10:58.863196 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-c7f84f2a-f224-4c37-ac91-e3db2b621b6e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:58.863854 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-c7f84f2a-f224-4c37-ac91-e3db2b621b6e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:58.870242 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c7f84f2a-f224-4c37-ac91-e3db2b621b6e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:58.870913 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c7f84f2a-f224-4c37-ac91-e3db2b621b6e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:58.871679 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c7f84f2a-f224-4c37-ac91-e3db2b621b6e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:58.872886 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c7f84f2a-f224-4c37-ac91-e3db2b621b6e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:59.085232 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-c7f84f2a-f224-4c37-ac91-e3db2b621b6e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:59.094146 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-c7f84f2a-f224-4c37-ac91-e3db2b621b6e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1723 microversion: 2.1 time: 0.234771 Jul 04 10:10:59.094732 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 146/296] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:58 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:10:59.099146 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-2f76b611-7173-477f-ae7a-6ff67082f165 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:59.099919 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-2f76b611-7173-477f-ae7a-6ff67082f165 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 13a952ca-c64f-4b22-89d3-3911935ee74d] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:59.106416 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2f76b611-7173-477f-ae7a-6ff67082f165 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:59.106678 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-6ddf38de-4a6c-4d8a-a190-7eca73cdfd3a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Flavor limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 10:10:59.107255 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2f76b611-7173-477f-ae7a-6ff67082f165 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:59.107478 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-6ddf38de-4a6c-4d8a-a190-7eca73cdfd3a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Image limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 10:10:59.107768 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-6ddf38de-4a6c-4d8a-a190-7eca73cdfd3a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Flavor pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 10:10:59.108288 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2f76b611-7173-477f-ae7a-6ff67082f165 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:59.108427 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-6ddf38de-4a6c-4d8a-a190-7eca73cdfd3a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Image pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 10:10:59.108683 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-6ddf38de-4a6c-4d8a-a190-7eca73cdfd3a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 10:10:59.115195 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2f76b611-7173-477f-ae7a-6ff67082f165 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:59.118751 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6ddf38de-4a6c-4d8a-a190-7eca73cdfd3a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:59.119195 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6ddf38de-4a6c-4d8a-a190-7eca73cdfd3a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:59.119984 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6ddf38de-4a6c-4d8a-a190-7eca73cdfd3a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:59.120430 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6ddf38de-4a6c-4d8a-a190-7eca73cdfd3a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:59.120821 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:59.138362 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-6ddf38de-4a6c-4d8a-a190-7eca73cdfd3a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Getting quotas for project 7f101e48ae9b4936a6d1b7bae000d7e1. Resources: {'cores', 'ram', 'instances'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 10:10:59.142967 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-6ddf38de-4a6c-4d8a-a190-7eca73cdfd3a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Getting quotas for user fc9c26318d6c41f6b9455153f0d0e55b and project 7f101e48ae9b4936a6d1b7bae000d7e1. Resources: {'cores', 'ram', 'instances'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 10:10:59.154930 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-6ddf38de-4a6c-4d8a-a190-7eca73cdfd3a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Going to run 1 instances... {{(pid=117865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 10:10:59.157211 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-6ddf38de-4a6c-4d8a-a190-7eca73cdfd3a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80bd29b0-b77c-4611-be31-69ca559a2d2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 10:10:59.217718 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-6ddf38de-4a6c-4d8a-a190-7eca73cdfd3a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.890002 Jul 04 10:10:59.218930 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 151/297] 10.222.0.79 () {60 vars in 1146 bytes} [Mon Jul 4 10:10:58 2022] POST /compute/v2.1/servers => generated 409 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 04 10:10:59.228326 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5da6afe5-f555-45ef-8742-5841a5ec816e tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:59.229110 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-5da6afe5-f555-45ef-8742-5841a5ec816e tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:59.272815 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-2f76b611-7173-477f-ae7a-6ff67082f165 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:59.281534 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-2f76b611-7173-477f-ae7a-6ff67082f165 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d" status: 200 len: 1368 microversion: 2.1 time: 0.185697 Jul 04 10:10:59.282128 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 147/298] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:59 2022] GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d => generated 1368 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:10:59.290269 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-5da6afe5-f555-45ef-8742-5841a5ec816e tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:59.299734 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-5da6afe5-f555-45ef-8742-5841a5ec816e tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1245 microversion: 2.1 time: 0.075132 Jul 04 10:10:59.300331 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 152/299] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:10:59 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1245 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:10:59.732916 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-a5f3697e-9539-4f86-a9ca-0059bc322c1b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:10:59.733517 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-a5f3697e-9539-4f86-a9ca-0059bc322c1b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:10:59.740128 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a5f3697e-9539-4f86-a9ca-0059bc322c1b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:59.740574 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a5f3697e-9539-4f86-a9ca-0059bc322c1b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:59.741326 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a5f3697e-9539-4f86-a9ca-0059bc322c1b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:10:59.741788 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a5f3697e-9539-4f86-a9ca-0059bc322c1b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:10:59.883405 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-a5f3697e-9539-4f86-a9ca-0059bc322c1b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:59.894207 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-a5f3697e-9539-4f86-a9ca-0059bc322c1b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:59.895699 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-a5f3697e-9539-4f86-a9ca-0059bc322c1b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:10:59.896863 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-a5f3697e-9539-4f86-a9ca-0059bc322c1b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1721 microversion: 2.20 time: 0.168219 Jul 04 10:10:59.897518 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 148/300] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:10:59 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:00.117387 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8709f06a-7843-474b-a94e-a7349a0a7d18 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:00.118098 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-8709f06a-7843-474b-a94e-a7349a0a7d18 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:00.127284 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8709f06a-7843-474b-a94e-a7349a0a7d18 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:00.127983 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8709f06a-7843-474b-a94e-a7349a0a7d18 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:00.128936 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8709f06a-7843-474b-a94e-a7349a0a7d18 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:00.129362 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8709f06a-7843-474b-a94e-a7349a0a7d18 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:00.278310 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-8709f06a-7843-474b-a94e-a7349a0a7d18 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:00.286778 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-8709f06a-7843-474b-a94e-a7349a0a7d18 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1723 microversion: 2.1 time: 0.173972 Jul 04 10:11:00.287320 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 153/301] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:11:00 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:11:00.299267 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-79a211b2-21b3-4b1e-9c5b-e53eaf3ee5dd tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:00.299955 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-79a211b2-21b3-4b1e-9c5b-e53eaf3ee5dd tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 13a952ca-c64f-4b22-89d3-3911935ee74d] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:00.307003 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-79a211b2-21b3-4b1e-9c5b-e53eaf3ee5dd tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:00.307600 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-79a211b2-21b3-4b1e-9c5b-e53eaf3ee5dd tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:00.308445 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-79a211b2-21b3-4b1e-9c5b-e53eaf3ee5dd tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:00.308880 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-79a211b2-21b3-4b1e-9c5b-e53eaf3ee5dd tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:00.316456 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-4e117e21-0a56-42a7-a4f3-f8681f9bd482 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:00.317050 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-4e117e21-0a56-42a7-a4f3-f8681f9bd482 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:00.323134 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4e117e21-0a56-42a7-a4f3-f8681f9bd482 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:00.323736 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4e117e21-0a56-42a7-a4f3-f8681f9bd482 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:00.324527 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4e117e21-0a56-42a7-a4f3-f8681f9bd482 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:00.324966 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4e117e21-0a56-42a7-a4f3-f8681f9bd482 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:00.408640 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-4e117e21-0a56-42a7-a4f3-f8681f9bd482 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:00.416472 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-4e117e21-0a56-42a7-a4f3-f8681f9bd482 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1297 microversion: 2.1 time: 0.103812 Jul 04 10:11:00.417015 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 154/302] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:11:00 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1297 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:11:00.475278 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-79a211b2-21b3-4b1e-9c5b-e53eaf3ee5dd tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:00.482876 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-79a211b2-21b3-4b1e-9c5b-e53eaf3ee5dd tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d" status: 200 len: 1368 microversion: 2.1 time: 0.187631 Jul 04 10:11:00.483425 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 149/303] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:11:00 2022] GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:11:00.916013 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-92a6d9aa-975e-4b23-af32-4398fd395e24 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:00.917078 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-92a6d9aa-975e-4b23-af32-4398fd395e24 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:00.919256 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:00.925427 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-92a6d9aa-975e-4b23-af32-4398fd395e24 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:00.926042 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-92a6d9aa-975e-4b23-af32-4398fd395e24 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:00.926865 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-92a6d9aa-975e-4b23-af32-4398fd395e24 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:00.927457 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-92a6d9aa-975e-4b23-af32-4398fd395e24 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:01.112886 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-92a6d9aa-975e-4b23-af32-4398fd395e24 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:01.125966 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-92a6d9aa-975e-4b23-af32-4398fd395e24 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:01.128155 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-92a6d9aa-975e-4b23-af32-4398fd395e24 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:01.134468 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-92a6d9aa-975e-4b23-af32-4398fd395e24 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1721 microversion: 2.20 time: 0.218180 Jul 04 10:11:01.146506 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 155/304] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:00 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1721 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:01.306038 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-2c682c2e-6555-4829-b66b-ec75ffcdbadb tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:01.306635 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-2c682c2e-6555-4829-b66b-ec75ffcdbadb tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:01.313486 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2c682c2e-6555-4829-b66b-ec75ffcdbadb tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:01.313954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2c682c2e-6555-4829-b66b-ec75ffcdbadb tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:01.314712 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2c682c2e-6555-4829-b66b-ec75ffcdbadb tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:01.315129 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2c682c2e-6555-4829-b66b-ec75ffcdbadb tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:01.434374 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-28cb4ed2-3b71-4923-b716-fa2a82a8f6a2 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:01.435726 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-28cb4ed2-3b71-4923-b716-fa2a82a8f6a2 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:01.453386 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-28cb4ed2-3b71-4923-b716-fa2a82a8f6a2 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:01.453994 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-28cb4ed2-3b71-4923-b716-fa2a82a8f6a2 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:01.454790 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-28cb4ed2-3b71-4923-b716-fa2a82a8f6a2 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:01.455723 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-28cb4ed2-3b71-4923-b716-fa2a82a8f6a2 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:01.523910 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-2c682c2e-6555-4829-b66b-ec75ffcdbadb tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:01.532302 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-2c682c2e-6555-4829-b66b-ec75ffcdbadb tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1723 microversion: 2.1 time: 0.230982 Jul 04 10:11:01.532833 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 150/305] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:11:01 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:11:01.537318 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-eba89cbd-4e5e-4a6c-988b-487182ffd100 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:01.537943 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-eba89cbd-4e5e-4a6c-988b-487182ffd100 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 13a952ca-c64f-4b22-89d3-3911935ee74d] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:01.543977 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-eba89cbd-4e5e-4a6c-988b-487182ffd100 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:01.544431 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-eba89cbd-4e5e-4a6c-988b-487182ffd100 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:01.545458 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-eba89cbd-4e5e-4a6c-988b-487182ffd100 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:01.545913 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-eba89cbd-4e5e-4a6c-988b-487182ffd100 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:01.546253 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-28cb4ed2-3b71-4923-b716-fa2a82a8f6a2 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:01.555375 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-28cb4ed2-3b71-4923-b716-fa2a82a8f6a2 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1303 microversion: 2.1 time: 0.125419 Jul 04 10:11:01.556013 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 156/306] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:11:01 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1303 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:11:01.772994 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-eba89cbd-4e5e-4a6c-988b-487182ffd100 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:01.780806 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-eba89cbd-4e5e-4a6c-988b-487182ffd100 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d" status: 200 len: 1368 microversion: 2.1 time: 0.246953 Jul 04 10:11:01.781786 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 151/307] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:11:01 2022] GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d => generated 1368 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:11:02.152669 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b810fccf-835e-4991-b071-ff9ea45fa1ee tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:02.153851 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-b810fccf-835e-4991-b071-ff9ea45fa1ee tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:02.160850 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b810fccf-835e-4991-b071-ff9ea45fa1ee tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:02.161328 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b810fccf-835e-4991-b071-ff9ea45fa1ee tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:02.166671 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b810fccf-835e-4991-b071-ff9ea45fa1ee tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:02.167121 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b810fccf-835e-4991-b071-ff9ea45fa1ee tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:02.393554 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-b810fccf-835e-4991-b071-ff9ea45fa1ee tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:02.401780 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-b810fccf-835e-4991-b071-ff9ea45fa1ee tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:02.403310 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-b810fccf-835e-4991-b071-ff9ea45fa1ee tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:02.404565 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-b810fccf-835e-4991-b071-ff9ea45fa1ee tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1721 microversion: 2.20 time: 0.255942 Jul 04 10:11:02.405110 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 157/308] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:02 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1721 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:02.557940 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-8d15dbf4-5133-4959-9f7e-2348e59e5e4d tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:02.559394 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-8d15dbf4-5133-4959-9f7e-2348e59e5e4d tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:02.573147 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-6ee6eddf-8fea-42dc-8ae4-ca885e59c07f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:02.573906 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-6ee6eddf-8fea-42dc-8ae4-ca885e59c07f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:02.574924 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8d15dbf4-5133-4959-9f7e-2348e59e5e4d tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:02.575718 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8d15dbf4-5133-4959-9f7e-2348e59e5e4d tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:02.576745 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8d15dbf4-5133-4959-9f7e-2348e59e5e4d tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:02.577336 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8d15dbf4-5133-4959-9f7e-2348e59e5e4d tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:02.584443 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6ee6eddf-8fea-42dc-8ae4-ca885e59c07f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:02.587655 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6ee6eddf-8fea-42dc-8ae4-ca885e59c07f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:02.591841 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6ee6eddf-8fea-42dc-8ae4-ca885e59c07f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:02.592344 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6ee6eddf-8fea-42dc-8ae4-ca885e59c07f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:02.890099 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-6ee6eddf-8fea-42dc-8ae4-ca885e59c07f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:02.897932 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-6ee6eddf-8fea-42dc-8ae4-ca885e59c07f tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1371 microversion: 2.1 time: 0.329179 Jul 04 10:11:02.898494 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 158/309] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:11:02 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1371 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:11:02.903322 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-8d15dbf4-5133-4959-9f7e-2348e59e5e4d tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:02.903690 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-4780f3ab-3c28-4370-bf8a-aa8486db4c8f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:02.904487 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-4780f3ab-3c28-4370-bf8a-aa8486db4c8f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 13a952ca-c64f-4b22-89d3-3911935ee74d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:02.911028 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4780f3ab-3c28-4370-bf8a-aa8486db4c8f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:02.911694 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4780f3ab-3c28-4370-bf8a-aa8486db4c8f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:02.912458 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-8d15dbf4-5133-4959-9f7e-2348e59e5e4d tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1700 microversion: 2.1 time: 0.366580 Jul 04 10:11:02.912605 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4780f3ab-3c28-4370-bf8a-aa8486db4c8f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:02.912891 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4780f3ab-3c28-4370-bf8a-aa8486db4c8f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:02.918222 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 152/310] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:11:02 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1700 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:11:02.940308 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-fb091247-3a45-4305-a80d-0cfd1eef5112 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:11:02.948556 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-fb091247-3a45-4305-a80d-0cfd1eef5112 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:02.949461 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-fb091247-3a45-4305-a80d-0cfd1eef5112 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:02.975149 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-fb091247-3a45-4305-a80d-0cfd1eef5112 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Going to try to start instance {{(pid=117866) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 04 10:11:03.037547 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-fb091247-3a45-4305-a80d-0cfd1eef5112 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "POST /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7/action" status: 202 len: 0 microversion: 2.1 time: 0.099980 Jul 04 10:11:03.045270 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 153/311] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Jul 4 10:11:02 2022] POST /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 10:11:03.047092 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-de4f0845-00c6-44d3-b175-7b86680ea8de req-1ada8adf-bf90-44ca-9819-281df52503cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cae1c9c4-3ee8-4aae-8911-21df5f3c37df", "tag": "983beb0b-565d-4f4f-b77c-f373196c5bdc"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:11:03.075048 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-de4f0845-00c6-44d3-b175-7b86680ea8de req-1ada8adf-bf90-44ca-9819-281df52503cb service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:03.075720 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-de4f0845-00c6-44d3-b175-7b86680ea8de req-1ada8adf-bf90-44ca-9819-281df52503cb service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:03.093824 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-de4f0845-00c6-44d3-b175-7b86680ea8de req-1ada8adf-bf90-44ca-9819-281df52503cb service nova] Creating event network-changed:983beb0b-565d-4f4f-b77c-f373196c5bdc for instance cae1c9c4-3ee8-4aae-8911-21df5f3c37df on hv-cinder-84841 Jul 04 10:11:03.103481 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-de4f0845-00c6-44d3-b175-7b86680ea8de req-1ada8adf-bf90-44ca-9819-281df52503cb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062885 Jul 04 10:11:03.104508 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 154/312] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:11:03.111162 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-06b6ab68-8b2a-4194-aefa-a854cc8317ee tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:03.112101 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-06b6ab68-8b2a-4194-aefa-a854cc8317ee tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:03.126710 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-06b6ab68-8b2a-4194-aefa-a854cc8317ee tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:03.127184 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-06b6ab68-8b2a-4194-aefa-a854cc8317ee tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:03.138512 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-06b6ab68-8b2a-4194-aefa-a854cc8317ee tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:03.139772 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-06b6ab68-8b2a-4194-aefa-a854cc8317ee tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:03.349944 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-4780f3ab-3c28-4370-bf8a-aa8486db4c8f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:03.357900 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-4780f3ab-3c28-4370-bf8a-aa8486db4c8f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d" status: 200 len: 1368 microversion: 2.1 time: 0.458099 Jul 04 10:11:03.359016 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 159/313] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:11:02 2022] GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d => generated 1368 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:11:03.423567 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f7c2cc50-6285-4fe9-a45e-e1bd348dea14 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:03.424273 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f7c2cc50-6285-4fe9-a45e-e1bd348dea14 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:03.426101 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-06b6ab68-8b2a-4194-aefa-a854cc8317ee tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:03.436650 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f7c2cc50-6285-4fe9-a45e-e1bd348dea14 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:03.437504 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f7c2cc50-6285-4fe9-a45e-e1bd348dea14 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:03.438541 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f7c2cc50-6285-4fe9-a45e-e1bd348dea14 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:03.439174 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f7c2cc50-6285-4fe9-a45e-e1bd348dea14 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:03.440224 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-06b6ab68-8b2a-4194-aefa-a854cc8317ee tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1709 microversion: 2.1 time: 0.334443 Jul 04 10:11:03.441059 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 155/314] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:11:03 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1709 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:11:03.636316 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-f7c2cc50-6285-4fe9-a45e-e1bd348dea14 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:03.649441 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-f7c2cc50-6285-4fe9-a45e-e1bd348dea14 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:03.651464 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-f7c2cc50-6285-4fe9-a45e-e1bd348dea14 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:03.653798 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f7c2cc50-6285-4fe9-a45e-e1bd348dea14 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1721 microversion: 2.20 time: 0.234475 Jul 04 10:11:03.655549 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 160/315] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:03 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1721 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:03.789996 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-db4c04e4-adfa-4221-b2d2-b94780c01e9b req-8a4a4e06-b7ad-48d6-887b-4dbed555a838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a952ca-c64f-4b22-89d3-3911935ee74d", "name": "network-vif-plugged", "status": "completed", "tag": "391d4036-90c2-4805-86d2-58d8be59784d"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:11:03.799789 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-db4c04e4-adfa-4221-b2d2-b94780c01e9b req-8a4a4e06-b7ad-48d6-887b-4dbed555a838 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:03.800354 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-db4c04e4-adfa-4221-b2d2-b94780c01e9b req-8a4a4e06-b7ad-48d6-887b-4dbed555a838 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:03.813700 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-db4c04e4-adfa-4221-b2d2-b94780c01e9b req-8a4a4e06-b7ad-48d6-887b-4dbed555a838 service nova] Creating event network-vif-plugged:391d4036-90c2-4805-86d2-58d8be59784d for instance 13a952ca-c64f-4b22-89d3-3911935ee74d on hv-cinder-84841 Jul 04 10:11:03.818679 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-db4c04e4-adfa-4221-b2d2-b94780c01e9b req-8a4a4e06-b7ad-48d6-887b-4dbed555a838 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032404 Jul 04 10:11:03.819614 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 156/316] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:11:03.914575 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-1128dd19-c4a9-4c54-9a9b-9d20044bffce tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:03.915312 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-1128dd19-c4a9-4c54-9a9b-9d20044bffce tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:03.923186 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1128dd19-c4a9-4c54-9a9b-9d20044bffce tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:03.923732 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1128dd19-c4a9-4c54-9a9b-9d20044bffce tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:03.925111 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1128dd19-c4a9-4c54-9a9b-9d20044bffce tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:03.925783 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1128dd19-c4a9-4c54-9a9b-9d20044bffce tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:04.071536 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-1128dd19-c4a9-4c54-9a9b-9d20044bffce tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:04.080940 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-1128dd19-c4a9-4c54-9a9b-9d20044bffce tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1371 microversion: 2.1 time: 0.170162 Jul 04 10:11:04.081999 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 161/317] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:11:03 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:11:04.376481 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-00b8ed7d-e1a9-4df9-8d21-4cb881f0e4de tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:04.377165 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-00b8ed7d-e1a9-4df9-8d21-4cb881f0e4de tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 13a952ca-c64f-4b22-89d3-3911935ee74d] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:04.384035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-00b8ed7d-e1a9-4df9-8d21-4cb881f0e4de tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:04.384475 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-00b8ed7d-e1a9-4df9-8d21-4cb881f0e4de tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:04.385230 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-00b8ed7d-e1a9-4df9-8d21-4cb881f0e4de tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:04.385655 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-00b8ed7d-e1a9-4df9-8d21-4cb881f0e4de tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:04.458603 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-056eef06-c61d-4122-a15e-177beafc7555 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:04.459200 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-056eef06-c61d-4122-a15e-177beafc7555 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:04.465995 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-056eef06-c61d-4122-a15e-177beafc7555 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:04.466480 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-056eef06-c61d-4122-a15e-177beafc7555 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:04.467240 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-056eef06-c61d-4122-a15e-177beafc7555 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:04.467682 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-056eef06-c61d-4122-a15e-177beafc7555 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:04.549449 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-00b8ed7d-e1a9-4df9-8d21-4cb881f0e4de tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:04.557724 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-00b8ed7d-e1a9-4df9-8d21-4cb881f0e4de tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d" status: 200 len: 1368 microversion: 2.1 time: 0.185823 Jul 04 10:11:04.558399 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 157/318] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:11:04 2022] GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d => generated 1368 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:11:04.619254 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-056eef06-c61d-4122-a15e-177beafc7555 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:04.632562 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-056eef06-c61d-4122-a15e-177beafc7555 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1709 microversion: 2.1 time: 0.177577 Jul 04 10:11:04.633284 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 162/319] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:11:04 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1709 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:11:04.674466 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-9d848eae-acb8-41f2-99fd-cf91d1bd64e5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:04.675065 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-9d848eae-acb8-41f2-99fd-cf91d1bd64e5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:04.681236 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9d848eae-acb8-41f2-99fd-cf91d1bd64e5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:04.682078 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9d848eae-acb8-41f2-99fd-cf91d1bd64e5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:04.682842 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9d848eae-acb8-41f2-99fd-cf91d1bd64e5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:04.683279 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9d848eae-acb8-41f2-99fd-cf91d1bd64e5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:04.822066 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-9d848eae-acb8-41f2-99fd-cf91d1bd64e5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:04.830456 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-9d848eae-acb8-41f2-99fd-cf91d1bd64e5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:04.831959 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-9d848eae-acb8-41f2-99fd-cf91d1bd64e5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:04.833155 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-9d848eae-acb8-41f2-99fd-cf91d1bd64e5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1721 microversion: 2.20 time: 0.162752 Jul 04 10:11:04.834688 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 158/320] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:04 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:05.098509 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-ecadcd74-8eba-4e40-9a23-ed998e5f7b04 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:05.099085 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-ecadcd74-8eba-4e40-9a23-ed998e5f7b04 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:05.107971 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ecadcd74-8eba-4e40-9a23-ed998e5f7b04 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:05.108714 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ecadcd74-8eba-4e40-9a23-ed998e5f7b04 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:05.110463 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ecadcd74-8eba-4e40-9a23-ed998e5f7b04 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:05.111235 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ecadcd74-8eba-4e40-9a23-ed998e5f7b04 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:05.395324 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-ecadcd74-8eba-4e40-9a23-ed998e5f7b04 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:05.403240 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-ecadcd74-8eba-4e40-9a23-ed998e5f7b04 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1371 microversion: 2.1 time: 0.308636 Jul 04 10:11:05.403893 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 163/321] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:11:05 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1371 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:11:05.575104 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-0b711e3c-2775-469e-87ed-27c30d7e7c16 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:05.575712 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-0b711e3c-2775-469e-87ed-27c30d7e7c16 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 13a952ca-c64f-4b22-89d3-3911935ee74d] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:05.577741 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell0:SELECT=2 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:05.579008 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell0:SELECT=10 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:05.585009 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0b711e3c-2775-469e-87ed-27c30d7e7c16 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:05.585453 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0b711e3c-2775-469e-87ed-27c30d7e7c16 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:05.586221 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0b711e3c-2775-469e-87ed-27c30d7e7c16 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:05.586652 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0b711e3c-2775-469e-87ed-27c30d7e7c16 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:05.654383 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-9a8294e6-ce8b-4bb0-9ec3-62e244ae9a7b tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:05.655234 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-9a8294e6-ce8b-4bb0-9ec3-62e244ae9a7b tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:05.671554 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9a8294e6-ce8b-4bb0-9ec3-62e244ae9a7b tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:05.672777 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9a8294e6-ce8b-4bb0-9ec3-62e244ae9a7b tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:05.674982 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9a8294e6-ce8b-4bb0-9ec3-62e244ae9a7b tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:05.676191 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9a8294e6-ce8b-4bb0-9ec3-62e244ae9a7b tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:05.766500 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-0b711e3c-2775-469e-87ed-27c30d7e7c16 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:05.775037 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-0b711e3c-2775-469e-87ed-27c30d7e7c16 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d" status: 200 len: 1368 microversion: 2.1 time: 0.203740 Jul 04 10:11:05.775866 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 159/322] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:11:05 2022] GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d => generated 1368 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:11:05.852793 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-47ab930a-8b9a-492a-a720-0c287ac8bae2 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:05.853398 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-47ab930a-8b9a-492a-a720-0c287ac8bae2 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:05.859938 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-47ab930a-8b9a-492a-a720-0c287ac8bae2 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:05.860402 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-47ab930a-8b9a-492a-a720-0c287ac8bae2 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:05.861134 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-47ab930a-8b9a-492a-a720-0c287ac8bae2 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:05.861578 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-47ab930a-8b9a-492a-a720-0c287ac8bae2 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:05.963472 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-9a8294e6-ce8b-4bb0-9ec3-62e244ae9a7b tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:05.972299 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-9a8294e6-ce8b-4bb0-9ec3-62e244ae9a7b tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1709 microversion: 2.1 time: 0.324198 Jul 04 10:11:05.977815 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 164/323] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:11:05 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1709 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:11:06.080076 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-47ab930a-8b9a-492a-a720-0c287ac8bae2 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:06.090025 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-47ab930a-8b9a-492a-a720-0c287ac8bae2 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:06.092387 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-47ab930a-8b9a-492a-a720-0c287ac8bae2 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:06.093956 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-47ab930a-8b9a-492a-a720-0c287ac8bae2 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1742 microversion: 2.20 time: 0.245308 Jul 04 10:11:06.094963 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 160/324] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:05 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1742 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 10:11:06.420415 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-0c0c51be-911d-4f05-9194-88f946586d70 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:06.420944 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-0c0c51be-911d-4f05-9194-88f946586d70 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:06.427039 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0c0c51be-911d-4f05-9194-88f946586d70 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:06.427480 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0c0c51be-911d-4f05-9194-88f946586d70 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:06.428259 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0c0c51be-911d-4f05-9194-88f946586d70 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:06.428693 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0c0c51be-911d-4f05-9194-88f946586d70 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:06.431261 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=100 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:06.563796 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-0c0c51be-911d-4f05-9194-88f946586d70 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:06.571570 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-0c0c51be-911d-4f05-9194-88f946586d70 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1371 microversion: 2.1 time: 0.155176 Jul 04 10:11:06.572142 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 165/325] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:11:06 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:11:06.797510 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-f208cd0e-821d-42e5-886b-78c4600510f9 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:06.798299 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-f208cd0e-821d-42e5-886b-78c4600510f9 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 13a952ca-c64f-4b22-89d3-3911935ee74d] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:06.805723 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f208cd0e-821d-42e5-886b-78c4600510f9 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:06.806225 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f208cd0e-821d-42e5-886b-78c4600510f9 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:06.807095 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f208cd0e-821d-42e5-886b-78c4600510f9 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:06.807590 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f208cd0e-821d-42e5-886b-78c4600510f9 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:06.947536 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-f208cd0e-821d-42e5-886b-78c4600510f9 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:06.955379 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-f208cd0e-821d-42e5-886b-78c4600510f9 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d" status: 200 len: 1368 microversion: 2.1 time: 0.164287 Jul 04 10:11:06.956172 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 161/326] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:11:06 2022] GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:11:06.988972 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-21f55b43-71a3-4628-aeb5-8a808be1cec6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:06.989509 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-21f55b43-71a3-4628-aeb5-8a808be1cec6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:06.996128 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-21f55b43-71a3-4628-aeb5-8a808be1cec6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:06.996561 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-21f55b43-71a3-4628-aeb5-8a808be1cec6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:06.997322 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-21f55b43-71a3-4628-aeb5-8a808be1cec6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:06.997776 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-21f55b43-71a3-4628-aeb5-8a808be1cec6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:07.111926 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-05d2d584-993d-441a-949b-b8495b8f56ab tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:07.112530 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-05d2d584-993d-441a-949b-b8495b8f56ab tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:07.114459 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:07.119589 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-05d2d584-993d-441a-949b-b8495b8f56ab tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:07.119739 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-05d2d584-993d-441a-949b-b8495b8f56ab tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:07.120530 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-05d2d584-993d-441a-949b-b8495b8f56ab tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:07.120956 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-05d2d584-993d-441a-949b-b8495b8f56ab tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:07.245612 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-21f55b43-71a3-4628-aeb5-8a808be1cec6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:07.254088 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-21f55b43-71a3-4628-aeb5-8a808be1cec6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1713 microversion: 2.1 time: 0.268932 Jul 04 10:11:07.254669 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 166/327] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:11:06 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1713 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:11:07.356898 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-05d2d584-993d-441a-949b-b8495b8f56ab tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:07.365986 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-05d2d584-993d-441a-949b-b8495b8f56ab tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:07.367466 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-05d2d584-993d-441a-949b-b8495b8f56ab tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:07.368772 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-05d2d584-993d-441a-949b-b8495b8f56ab tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1742 microversion: 2.20 time: 0.261013 Jul 04 10:11:07.369685 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 162/328] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:07 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1742 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:07.588562 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f3398d72-55a5-4800-8e6e-1535c73c69ad tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:07.589161 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f3398d72-55a5-4800-8e6e-1535c73c69ad tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:07.595784 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f3398d72-55a5-4800-8e6e-1535c73c69ad tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:07.596227 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f3398d72-55a5-4800-8e6e-1535c73c69ad tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:07.596987 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f3398d72-55a5-4800-8e6e-1535c73c69ad tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:07.597415 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f3398d72-55a5-4800-8e6e-1535c73c69ad tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:07.740250 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-f3398d72-55a5-4800-8e6e-1535c73c69ad tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:07.750493 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f3398d72-55a5-4800-8e6e-1535c73c69ad tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1371 microversion: 2.1 time: 0.165751 Jul 04 10:11:07.755269 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 167/329] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:11:07 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:11:07.974023 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-bff5763c-fe82-4011-ba3d-cad495112cde tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:07.974859 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-bff5763c-fe82-4011-ba3d-cad495112cde tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 13a952ca-c64f-4b22-89d3-3911935ee74d] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:07.982075 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-bff5763c-fe82-4011-ba3d-cad495112cde tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:07.982617 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-bff5763c-fe82-4011-ba3d-cad495112cde tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:07.983805 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-bff5763c-fe82-4011-ba3d-cad495112cde tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:07.984302 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-bff5763c-fe82-4011-ba3d-cad495112cde tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:08.096254 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-c3542dde-1faa-4ae1-916f-c4becb068105 req-79351018-1cae-4f85-af82-47977e6d6032 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cae1c9c4-3ee8-4aae-8911-21df5f3c37df", "name": "network-vif-plugged", "status": "completed", "tag": "983beb0b-565d-4f4f-b77c-f373196c5bdc"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:11:08.106910 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-c3542dde-1faa-4ae1-916f-c4becb068105 req-79351018-1cae-4f85-af82-47977e6d6032 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:08.107812 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-c3542dde-1faa-4ae1-916f-c4becb068105 req-79351018-1cae-4f85-af82-47977e6d6032 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:08.125816 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-c3542dde-1faa-4ae1-916f-c4becb068105 req-79351018-1cae-4f85-af82-47977e6d6032 service nova] Creating event network-vif-plugged:983beb0b-565d-4f4f-b77c-f373196c5bdc for instance cae1c9c4-3ee8-4aae-8911-21df5f3c37df on hv-cinder-84841 Jul 04 10:11:08.133229 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-c3542dde-1faa-4ae1-916f-c4becb068105 req-79351018-1cae-4f85-af82-47977e6d6032 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043429 Jul 04 10:11:08.135064 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 168/330] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:11:08.392274 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-12cafd6a-35a9-4819-af00-b9f3c7a4aa7c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:08.393477 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-12cafd6a-35a9-4819-af00-b9f3c7a4aa7c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:08.412083 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-12cafd6a-35a9-4819-af00-b9f3c7a4aa7c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:08.412528 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-12cafd6a-35a9-4819-af00-b9f3c7a4aa7c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:08.413595 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-12cafd6a-35a9-4819-af00-b9f3c7a4aa7c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:08.414125 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-12cafd6a-35a9-4819-af00-b9f3c7a4aa7c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:08.528906 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-bff5763c-fe82-4011-ba3d-cad495112cde tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:08.537029 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-bff5763c-fe82-4011-ba3d-cad495112cde tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d" status: 200 len: 1558 microversion: 2.1 time: 0.567825 Jul 04 10:11:08.537642 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 163/331] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:11:07 2022] GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d => generated 1558 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:11:08.554391 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-27d0424f-463d-4605-bf73-a6c483a8beca tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:08.554902 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-27d0424f-463d-4605-bf73-a6c483a8beca tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 13a952ca-c64f-4b22-89d3-3911935ee74d] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:08.561202 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-27d0424f-463d-4605-bf73-a6c483a8beca tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:08.561632 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-27d0424f-463d-4605-bf73-a6c483a8beca tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:08.562500 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-27d0424f-463d-4605-bf73-a6c483a8beca tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:08.562936 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-27d0424f-463d-4605-bf73-a6c483a8beca tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:08.566755 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:08.744437 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-27d0424f-463d-4605-bf73-a6c483a8beca tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.194406 Jul 04 10:11:08.752164 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 164/332] 10.222.0.79 () {58 vars in 1274 bytes} [Mon Jul 4 10:11:08 2022] GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d/os-interface => generated 285 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:11:08.763291 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-12cafd6a-35a9-4819-af00-b9f3c7a4aa7c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:08.768719 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-241f3772-948f-43c7-b2a2-dfa3253e6c51 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:08.769558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-241f3772-948f-43c7-b2a2-dfa3253e6c51 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:08.781070 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-241f3772-948f-43c7-b2a2-dfa3253e6c51 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:08.781885 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-241f3772-948f-43c7-b2a2-dfa3253e6c51 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:08.783166 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-241f3772-948f-43c7-b2a2-dfa3253e6c51 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:08.784573 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-241f3772-948f-43c7-b2a2-dfa3253e6c51 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:08.787460 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-12cafd6a-35a9-4819-af00-b9f3c7a4aa7c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:08.790739 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-12cafd6a-35a9-4819-af00-b9f3c7a4aa7c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:08.791944 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-12cafd6a-35a9-4819-af00-b9f3c7a4aa7c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1742 microversion: 2.20 time: 0.407401 Jul 04 10:11:08.792914 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 169/333] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:08 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1742 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:08.941220 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-241f3772-948f-43c7-b2a2-dfa3253e6c51 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:08.949996 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-241f3772-948f-43c7-b2a2-dfa3253e6c51 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1371 microversion: 2.1 time: 0.186193 Jul 04 10:11:08.950764 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 165/334] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:11:08 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:11:09.812438 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-18cc99b3-fb44-472b-8a2b-5a09d9b8d95b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:09.813044 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-18cc99b3-fb44-472b-8a2b-5a09d9b8d95b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:09.815761 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:09.817763 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=14 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:09.834873 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-18cc99b3-fb44-472b-8a2b-5a09d9b8d95b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:09.835326 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-18cc99b3-fb44-472b-8a2b-5a09d9b8d95b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:09.836114 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-18cc99b3-fb44-472b-8a2b-5a09d9b8d95b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:09.836537 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-18cc99b3-fb44-472b-8a2b-5a09d9b8d95b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:09.872337 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-79489b57-d0c1-4448-95fe-8a756a6631b3 req-a643f815-235b-466a-af19-871023a0a9d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13a952ca-c64f-4b22-89d3-3911935ee74d", "tag": "391d4036-90c2-4805-86d2-58d8be59784d"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:11:09.881682 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-79489b57-d0c1-4448-95fe-8a756a6631b3 req-a643f815-235b-466a-af19-871023a0a9d7 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:09.882292 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-79489b57-d0c1-4448-95fe-8a756a6631b3 req-a643f815-235b-466a-af19-871023a0a9d7 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:09.897860 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-79489b57-d0c1-4448-95fe-8a756a6631b3 req-a643f815-235b-466a-af19-871023a0a9d7 service nova] Creating event network-changed:391d4036-90c2-4805-86d2-58d8be59784d for instance 13a952ca-c64f-4b22-89d3-3911935ee74d on hv-cinder-84841 Jul 04 10:11:09.906709 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-79489b57-d0c1-4448-95fe-8a756a6631b3 req-a643f815-235b-466a-af19-871023a0a9d7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038791 Jul 04 10:11:09.911633 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 166/335] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 10:11:09.989996 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-032ea313-ef2e-4bb1-b953-74a24f2f4277 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:09.992264 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-032ea313-ef2e-4bb1-b953-74a24f2f4277 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:10.001745 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-032ea313-ef2e-4bb1-b953-74a24f2f4277 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:10.003091 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-032ea313-ef2e-4bb1-b953-74a24f2f4277 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:10.004210 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-032ea313-ef2e-4bb1-b953-74a24f2f4277 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:10.004986 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-032ea313-ef2e-4bb1-b953-74a24f2f4277 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:10.185840 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-18cc99b3-fb44-472b-8a2b-5a09d9b8d95b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:10.198350 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-18cc99b3-fb44-472b-8a2b-5a09d9b8d95b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:10.207989 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-18cc99b3-fb44-472b-8a2b-5a09d9b8d95b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:10.209444 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-18cc99b3-fb44-472b-8a2b-5a09d9b8d95b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1737 microversion: 2.20 time: 0.401856 Jul 04 10:11:10.210649 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 170/336] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:09 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1737 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:10.215394 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-ae29e237-dc33-4157-b66f-fa704e83b9ff req-913c3c3c-349d-425e-b7a7-d743d3498e5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2", "name": "network-vif-plugged", "status": "completed", "tag": "ca00e905-cd23-4f89-b9a3-2e4d9b7e6b31"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:11:10.236520 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-ae29e237-dc33-4157-b66f-fa704e83b9ff req-913c3c3c-349d-425e-b7a7-d743d3498e5c service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:10.237233 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-ae29e237-dc33-4157-b66f-fa704e83b9ff req-913c3c3c-349d-425e-b7a7-d743d3498e5c service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:10.266617 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-ae29e237-dc33-4157-b66f-fa704e83b9ff req-913c3c3c-349d-425e-b7a7-d743d3498e5c service nova] Creating event network-vif-plugged:ca00e905-cd23-4f89-b9a3-2e4d9b7e6b31 for instance ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 on hv-cinder-84841 Jul 04 10:11:10.277806 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-ae29e237-dc33-4157-b66f-fa704e83b9ff req-913c3c3c-349d-425e-b7a7-d743d3498e5c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065604 Jul 04 10:11:10.278668 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 171/337] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:11:10.301945 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-032ea313-ef2e-4bb1-b953-74a24f2f4277 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:10.313278 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-032ea313-ef2e-4bb1-b953-74a24f2f4277 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1371 microversion: 2.1 time: 0.347610 Jul 04 10:11:10.314186 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 167/338] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:11:09 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1371 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:11:11.235293 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-a599eb12-1ab0-49f3-a30e-bb9a37fde54b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:11.236911 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-a599eb12-1ab0-49f3-a30e-bb9a37fde54b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:11.244704 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a599eb12-1ab0-49f3-a30e-bb9a37fde54b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:11.245826 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a599eb12-1ab0-49f3-a30e-bb9a37fde54b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:11.246816 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a599eb12-1ab0-49f3-a30e-bb9a37fde54b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:11.247715 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a599eb12-1ab0-49f3-a30e-bb9a37fde54b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:11.331453 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-e30d7dc8-2222-40dc-b743-859dd756ee7c tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:11.332160 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-e30d7dc8-2222-40dc-b743-859dd756ee7c tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:11.351799 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e30d7dc8-2222-40dc-b743-859dd756ee7c tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:11.352238 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e30d7dc8-2222-40dc-b743-859dd756ee7c tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:11.356178 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e30d7dc8-2222-40dc-b743-859dd756ee7c tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:11.357985 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e30d7dc8-2222-40dc-b743-859dd756ee7c tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:11.579205 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-a599eb12-1ab0-49f3-a30e-bb9a37fde54b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:11.588949 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-a599eb12-1ab0-49f3-a30e-bb9a37fde54b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:11.595889 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-a599eb12-1ab0-49f3-a30e-bb9a37fde54b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:11.597220 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-a599eb12-1ab0-49f3-a30e-bb9a37fde54b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1737 microversion: 2.20 time: 0.368599 Jul 04 10:11:11.598375 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 172/339] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:11 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1737 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:11.692859 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-e30d7dc8-2222-40dc-b743-859dd756ee7c tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:11.706186 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-e30d7dc8-2222-40dc-b743-859dd756ee7c tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1565 microversion: 2.1 time: 0.379450 Jul 04 10:11:11.716288 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 168/340] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:11:11 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1565 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:11:11.724629 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8e84d13c-29f5-486e-9108-f2d975fea5d3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:11.725119 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-8e84d13c-29f5-486e-9108-f2d975fea5d3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:11.732277 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8e84d13c-29f5-486e-9108-f2d975fea5d3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:11.732722 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8e84d13c-29f5-486e-9108-f2d975fea5d3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:11.733491 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8e84d13c-29f5-486e-9108-f2d975fea5d3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:11.733989 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8e84d13c-29f5-486e-9108-f2d975fea5d3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:11.880818 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-8e84d13c-29f5-486e-9108-f2d975fea5d3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.160059 Jul 04 10:11:11.891694 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 173/341] 10.222.0.79 () {58 vars in 1274 bytes} [Mon Jul 4 10:11:11 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df/os-interface => generated 285 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:11:12.616771 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-d8687600-e571-4da6-978d-8cb856a96581 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:12.618235 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-d8687600-e571-4da6-978d-8cb856a96581 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:12.628133 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d8687600-e571-4da6-978d-8cb856a96581 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:12.630533 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d8687600-e571-4da6-978d-8cb856a96581 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:12.631704 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d8687600-e571-4da6-978d-8cb856a96581 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:12.632363 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d8687600-e571-4da6-978d-8cb856a96581 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:12.795291 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-d8687600-e571-4da6-978d-8cb856a96581 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:12.810176 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-d8687600-e571-4da6-978d-8cb856a96581 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:12.814532 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-d8687600-e571-4da6-978d-8cb856a96581 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:12.816094 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-d8687600-e571-4da6-978d-8cb856a96581 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1737 microversion: 2.20 time: 0.203604 Jul 04 10:11:12.827333 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 169/342] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:12 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:13.177370 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-5958352c-4448-47fa-bda7-630c7a18b25e req-1bf5ee71-86e5-494e-94c2-288588322d28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cae1c9c4-3ee8-4aae-8911-21df5f3c37df", "tag": "983beb0b-565d-4f4f-b77c-f373196c5bdc"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:11:13.192603 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-5958352c-4448-47fa-bda7-630c7a18b25e req-1bf5ee71-86e5-494e-94c2-288588322d28 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:13.193044 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-5958352c-4448-47fa-bda7-630c7a18b25e req-1bf5ee71-86e5-494e-94c2-288588322d28 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:13.239898 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-5958352c-4448-47fa-bda7-630c7a18b25e req-1bf5ee71-86e5-494e-94c2-288588322d28 service nova] Creating event network-changed:983beb0b-565d-4f4f-b77c-f373196c5bdc for instance cae1c9c4-3ee8-4aae-8911-21df5f3c37df on hv-cinder-84841 Jul 04 10:11:13.260295 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-5958352c-4448-47fa-bda7-630c7a18b25e req-1bf5ee71-86e5-494e-94c2-288588322d28 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093025 Jul 04 10:11:13.261346 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 174/343] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:11:13.835713 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-86629894-70ec-496b-98be-96ba68fe7288 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:13.836582 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-86629894-70ec-496b-98be-96ba68fe7288 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:13.849232 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-86629894-70ec-496b-98be-96ba68fe7288 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:13.849862 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-86629894-70ec-496b-98be-96ba68fe7288 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:13.850958 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-86629894-70ec-496b-98be-96ba68fe7288 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:13.852797 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-86629894-70ec-496b-98be-96ba68fe7288 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:14.153392 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-86629894-70ec-496b-98be-96ba68fe7288 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:14.166865 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-86629894-70ec-496b-98be-96ba68fe7288 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:14.168559 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-86629894-70ec-496b-98be-96ba68fe7288 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:14.169832 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-86629894-70ec-496b-98be-96ba68fe7288 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1737 microversion: 2.20 time: 0.339106 Jul 04 10:11:14.170586 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 170/344] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:13 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1737 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 10:11:15.189561 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e51dc65b-29a0-4d4a-ba23-d9800a4a0253 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:15.190295 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-e51dc65b-29a0-4d4a-ba23-d9800a4a0253 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:15.197537 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e51dc65b-29a0-4d4a-ba23-d9800a4a0253 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:15.198239 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e51dc65b-29a0-4d4a-ba23-d9800a4a0253 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:15.199252 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e51dc65b-29a0-4d4a-ba23-d9800a4a0253 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:15.199834 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e51dc65b-29a0-4d4a-ba23-d9800a4a0253 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:15.389409 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-e51dc65b-29a0-4d4a-ba23-d9800a4a0253 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:15.398371 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-e51dc65b-29a0-4d4a-ba23-d9800a4a0253 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:15.400212 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-e51dc65b-29a0-4d4a-ba23-d9800a4a0253 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:15.402780 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-e51dc65b-29a0-4d4a-ba23-d9800a4a0253 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1737 microversion: 2.20 time: 0.217998 Jul 04 10:11:15.403941 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 175/345] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:15 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1737 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:16.430053 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-41491983-8743-4e00-a8d2-3359a48f1613 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:16.430053 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-41491983-8743-4e00-a8d2-3359a48f1613 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:16.430909 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-41491983-8743-4e00-a8d2-3359a48f1613 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:16.431371 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-41491983-8743-4e00-a8d2-3359a48f1613 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:16.432819 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-41491983-8743-4e00-a8d2-3359a48f1613 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:16.433263 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-41491983-8743-4e00-a8d2-3359a48f1613 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:16.582437 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-41491983-8743-4e00-a8d2-3359a48f1613 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:16.591542 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-41491983-8743-4e00-a8d2-3359a48f1613 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:16.593558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-41491983-8743-4e00-a8d2-3359a48f1613 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:16.594971 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-41491983-8743-4e00-a8d2-3359a48f1613 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1737 microversion: 2.20 time: 0.175478 Jul 04 10:11:16.595757 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 171/346] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:16 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:17.613433 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f5598f2a-ae14-4f71-8381-eb9299894083 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:17.614044 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f5598f2a-ae14-4f71-8381-eb9299894083 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:17.620973 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f5598f2a-ae14-4f71-8381-eb9299894083 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:17.621419 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f5598f2a-ae14-4f71-8381-eb9299894083 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:17.622235 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f5598f2a-ae14-4f71-8381-eb9299894083 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:17.622660 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f5598f2a-ae14-4f71-8381-eb9299894083 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:17.769707 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-f5598f2a-ae14-4f71-8381-eb9299894083 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:17.778561 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-f5598f2a-ae14-4f71-8381-eb9299894083 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:17.780537 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-f5598f2a-ae14-4f71-8381-eb9299894083 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:17.782314 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f5598f2a-ae14-4f71-8381-eb9299894083 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1737 microversion: 2.20 time: 0.172916 Jul 04 10:11:17.783469 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 176/347] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:17 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:18.802260 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-db292f4c-4b67-49ee-86ad-649a4e820b4b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:18.803694 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-db292f4c-4b67-49ee-86ad-649a4e820b4b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:18.812092 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-db292f4c-4b67-49ee-86ad-649a4e820b4b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:18.813138 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-db292f4c-4b67-49ee-86ad-649a4e820b4b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:18.814033 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-db292f4c-4b67-49ee-86ad-649a4e820b4b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:18.814481 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-db292f4c-4b67-49ee-86ad-649a4e820b4b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:18.975248 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-db292f4c-4b67-49ee-86ad-649a4e820b4b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:18.985019 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-db292f4c-4b67-49ee-86ad-649a4e820b4b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:18.986671 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-db292f4c-4b67-49ee-86ad-649a4e820b4b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:18.988044 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-db292f4c-4b67-49ee-86ad-649a4e820b4b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1737 microversion: 2.20 time: 0.190510 Jul 04 10:11:18.988598 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 172/348] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:18 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1737 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:20.016108 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b78eb712-4e66-4d12-b426-e0f45f0f1450 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:20.017494 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-b78eb712-4e66-4d12-b426-e0f45f0f1450 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:20.024702 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b78eb712-4e66-4d12-b426-e0f45f0f1450 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:20.025151 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b78eb712-4e66-4d12-b426-e0f45f0f1450 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:20.025950 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b78eb712-4e66-4d12-b426-e0f45f0f1450 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:20.026543 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b78eb712-4e66-4d12-b426-e0f45f0f1450 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:20.194133 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-b78eb712-4e66-4d12-b426-e0f45f0f1450 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:20.203156 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-b78eb712-4e66-4d12-b426-e0f45f0f1450 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:20.205291 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-b78eb712-4e66-4d12-b426-e0f45f0f1450 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:20.207119 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-b78eb712-4e66-4d12-b426-e0f45f0f1450 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1737 microversion: 2.20 time: 0.194891 Jul 04 10:11:20.208276 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 177/349] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:20 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1737 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:21.231359 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-ef33e712-784f-4412-b184-e7d579598a14 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:21.232225 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-ef33e712-784f-4412-b184-e7d579598a14 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:21.243038 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ef33e712-784f-4412-b184-e7d579598a14 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:21.243737 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ef33e712-784f-4412-b184-e7d579598a14 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:21.245006 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ef33e712-784f-4412-b184-e7d579598a14 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:21.245871 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ef33e712-784f-4412-b184-e7d579598a14 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:21.456077 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-ef33e712-784f-4412-b184-e7d579598a14 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:21.464524 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-ef33e712-784f-4412-b184-e7d579598a14 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:21.466292 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-ef33e712-784f-4412-b184-e7d579598a14 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:21.467541 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-ef33e712-784f-4412-b184-e7d579598a14 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1719 microversion: 2.20 time: 0.243200 Jul 04 10:11:21.473526 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 173/350] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:21 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1719 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:22.487583 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-958d6b23-86de-45fc-ac80-3244ce043044 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:22.488212 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-958d6b23-86de-45fc-ac80-3244ce043044 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:22.495228 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-958d6b23-86de-45fc-ac80-3244ce043044 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:22.495666 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-958d6b23-86de-45fc-ac80-3244ce043044 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:22.496420 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-958d6b23-86de-45fc-ac80-3244ce043044 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:22.496834 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-958d6b23-86de-45fc-ac80-3244ce043044 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:22.847289 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-958d6b23-86de-45fc-ac80-3244ce043044 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:22.855271 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-958d6b23-86de-45fc-ac80-3244ce043044 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:22.856888 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-958d6b23-86de-45fc-ac80-3244ce043044 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:22.858235 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-958d6b23-86de-45fc-ac80-3244ce043044 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1719 microversion: 2.20 time: 0.374950 Jul 04 10:11:22.858987 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 178/351] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:22 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1719 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:23.876280 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-f91cdc81-2ba5-4468-bf21-2b5b325c28a5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:23.877225 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-f91cdc81-2ba5-4468-bf21-2b5b325c28a5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:23.883539 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f91cdc81-2ba5-4468-bf21-2b5b325c28a5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:23.883985 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f91cdc81-2ba5-4468-bf21-2b5b325c28a5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:23.884732 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f91cdc81-2ba5-4468-bf21-2b5b325c28a5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:23.885162 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f91cdc81-2ba5-4468-bf21-2b5b325c28a5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:24.034823 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-f91cdc81-2ba5-4468-bf21-2b5b325c28a5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:24.044783 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-f91cdc81-2ba5-4468-bf21-2b5b325c28a5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:24.046451 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-f91cdc81-2ba5-4468-bf21-2b5b325c28a5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:24.047636 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-f91cdc81-2ba5-4468-bf21-2b5b325c28a5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1719 microversion: 2.20 time: 0.175242 Jul 04 10:11:24.048201 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 174/352] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:23 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1719 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:25.066373 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-ffd7b425-1935-4cf4-bbe2-7034b4501d80 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:25.067023 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-ffd7b425-1935-4cf4-bbe2-7034b4501d80 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:25.073260 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ffd7b425-1935-4cf4-bbe2-7034b4501d80 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:25.073792 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ffd7b425-1935-4cf4-bbe2-7034b4501d80 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:25.074490 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ffd7b425-1935-4cf4-bbe2-7034b4501d80 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:25.074918 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ffd7b425-1935-4cf4-bbe2-7034b4501d80 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:25.213870 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-ffd7b425-1935-4cf4-bbe2-7034b4501d80 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:25.227176 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-ffd7b425-1935-4cf4-bbe2-7034b4501d80 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:25.228710 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-ffd7b425-1935-4cf4-bbe2-7034b4501d80 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:25.229887 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-ffd7b425-1935-4cf4-bbe2-7034b4501d80 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1662 microversion: 2.20 time: 0.167932 Jul 04 10:11:25.230557 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 179/353] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:25 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1662 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:25.247838 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-9b777d9d-c8dc-4b83-831b-7751befe9cf8 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51645fd5-c5ad-48c4-9a98-6511a001a07f"}} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:11:25.248945 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-9b777d9d-c8dc-4b83-831b-7751befe9cf8 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:25.255672 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9b777d9d-c8dc-4b83-831b-7751befe9cf8 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:25.256175 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9b777d9d-c8dc-4b83-831b-7751befe9cf8 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:25.257021 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9b777d9d-c8dc-4b83-831b-7751befe9cf8 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:25.257652 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9b777d9d-c8dc-4b83-831b-7751befe9cf8 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:25.589332 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-9b777d9d-c8dc-4b83-831b-7751befe9cf8 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "POST /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.345591 Jul 04 10:11:25.589951 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 175/354] 10.222.0.79 () {62 vars in 1363 bytes} [Mon Jul 4 10:11:25 2022] POST /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2/os-volume_attachments => generated 188 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 10:11:25.724005 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-0fd40bef-7438-4ce1-be52-8ac49cc0c7d7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:11:25.724744 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-0fd40bef-7438-4ce1-be52-8ac49cc0c7d7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:25.731178 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0fd40bef-7438-4ce1-be52-8ac49cc0c7d7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:25.731982 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0fd40bef-7438-4ce1-be52-8ac49cc0c7d7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:25.732813 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0fd40bef-7438-4ce1-be52-8ac49cc0c7d7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:25.733255 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0fd40bef-7438-4ce1-be52-8ac49cc0c7d7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:25.840454 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-0fd40bef-7438-4ce1-be52-8ac49cc0c7d7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "POST /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2/action" status: 202 len: 0 microversion: 2.20 time: 0.121260 Jul 04 10:11:25.841179 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 180/355] 10.222.0.79 () {62 vars in 1318 bytes} [Mon Jul 4 10:11:25 2022] POST /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 04 10:11:25.850550 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-0e7c421a-d621-4b31-b572-c37fa2672efd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:25.851426 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-0e7c421a-d621-4b31-b572-c37fa2672efd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:25.859362 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0e7c421a-d621-4b31-b572-c37fa2672efd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:25.859907 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0e7c421a-d621-4b31-b572-c37fa2672efd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:25.860032 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-9a1a5fb3-a253-41ae-8d23-ae973c09cd8b req-12918d10-e3f3-45f0-b8a7-885146b252c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2", "name": "network-vif-unplugged", "status": "completed", "tag": "ca00e905-cd23-4f89-b9a3-2e4d9b7e6b31"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:11:25.861101 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0e7c421a-d621-4b31-b572-c37fa2672efd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:25.861750 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0e7c421a-d621-4b31-b572-c37fa2672efd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:25.879612 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-9a1a5fb3-a253-41ae-8d23-ae973c09cd8b req-12918d10-e3f3-45f0-b8a7-885146b252c4 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:25.880041 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-9a1a5fb3-a253-41ae-8d23-ae973c09cd8b req-12918d10-e3f3-45f0-b8a7-885146b252c4 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:25.893341 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.compute.server_external_events [req-9a1a5fb3-a253-41ae-8d23-ae973c09cd8b req-12918d10-e3f3-45f0-b8a7-885146b252c4 service nova] Unable to find a host for instance ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2. Dropping event network-vif-unplugged {{(pid=117865) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 04 10:11:25.894510 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-9a1a5fb3-a253-41ae-8d23-ae973c09cd8b req-12918d10-e3f3-45f0-b8a7-885146b252c4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.038714 Jul 04 10:11:25.895787 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 181/356] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 40 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 04 10:11:26.060031 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-0e7c421a-d621-4b31-b572-c37fa2672efd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:26.074208 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-0e7c421a-d621-4b31-b572-c37fa2672efd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:26.075832 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-0e7c421a-d621-4b31-b572-c37fa2672efd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:26.081274 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-0e7c421a-d621-4b31-b572-c37fa2672efd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1748 microversion: 2.20 time: 0.231125 Jul 04 10:11:26.082335 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 176/357] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:25 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1748 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:27.102438 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-d68f4450-f04d-4d9e-8ec0-1c4756f0f90b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:27.103018 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d68f4450-f04d-4d9e-8ec0-1c4756f0f90b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:27.110271 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d68f4450-f04d-4d9e-8ec0-1c4756f0f90b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:27.112905 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d68f4450-f04d-4d9e-8ec0-1c4756f0f90b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:27.113761 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d68f4450-f04d-4d9e-8ec0-1c4756f0f90b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:27.114351 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d68f4450-f04d-4d9e-8ec0-1c4756f0f90b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:27.376556 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-d68f4450-f04d-4d9e-8ec0-1c4756f0f90b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:27.385556 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-d68f4450-f04d-4d9e-8ec0-1c4756f0f90b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:27.387105 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-d68f4450-f04d-4d9e-8ec0-1c4756f0f90b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:27.388265 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-d68f4450-f04d-4d9e-8ec0-1c4756f0f90b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1750 microversion: 2.20 time: 0.290631 Jul 04 10:11:27.388810 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 182/358] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:27 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1750 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:28.408942 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-17f12d0e-017e-451e-bf4a-08487804d7b9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:28.409593 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-17f12d0e-017e-451e-bf4a-08487804d7b9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:28.418197 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-17f12d0e-017e-451e-bf4a-08487804d7b9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:28.419011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-17f12d0e-017e-451e-bf4a-08487804d7b9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:28.420038 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-17f12d0e-017e-451e-bf4a-08487804d7b9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:28.421267 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-17f12d0e-017e-451e-bf4a-08487804d7b9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:28.785581 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-17f12d0e-017e-451e-bf4a-08487804d7b9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:28.796174 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-17f12d0e-017e-451e-bf4a-08487804d7b9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:28.800273 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-17f12d0e-017e-451e-bf4a-08487804d7b9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:28.803943 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-17f12d0e-017e-451e-bf4a-08487804d7b9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1806 microversion: 2.20 time: 0.398611 Jul 04 10:11:28.805926 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 177/359] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:28 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1806 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:29.825539 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-93e363e5-1dd7-48a5-89c2-7b7cd7b873ef tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:29.826192 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-93e363e5-1dd7-48a5-89c2-7b7cd7b873ef tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:29.847757 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-93e363e5-1dd7-48a5-89c2-7b7cd7b873ef tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:29.853087 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-93e363e5-1dd7-48a5-89c2-7b7cd7b873ef tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:29.854342 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-93e363e5-1dd7-48a5-89c2-7b7cd7b873ef tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:29.859470 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-93e363e5-1dd7-48a5-89c2-7b7cd7b873ef tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:30.189170 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-93e363e5-1dd7-48a5-89c2-7b7cd7b873ef tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:30.191918 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:30.205399 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-93e363e5-1dd7-48a5-89c2-7b7cd7b873ef tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:30.209188 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-93e363e5-1dd7-48a5-89c2-7b7cd7b873ef tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:30.210300 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-93e363e5-1dd7-48a5-89c2-7b7cd7b873ef tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1806 microversion: 2.20 time: 0.390297 Jul 04 10:11:30.210876 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 183/360] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:29 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1806 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:31.228398 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-7ccf57a1-952d-4fe4-9471-49eaa343c828 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:31.229830 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-7ccf57a1-952d-4fe4-9471-49eaa343c828 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:31.236458 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7ccf57a1-952d-4fe4-9471-49eaa343c828 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:31.237081 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7ccf57a1-952d-4fe4-9471-49eaa343c828 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:31.237908 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7ccf57a1-952d-4fe4-9471-49eaa343c828 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:31.238537 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7ccf57a1-952d-4fe4-9471-49eaa343c828 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:31.434126 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-7ccf57a1-952d-4fe4-9471-49eaa343c828 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:31.446298 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-7ccf57a1-952d-4fe4-9471-49eaa343c828 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:31.448220 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-7ccf57a1-952d-4fe4-9471-49eaa343c828 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:31.449658 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-7ccf57a1-952d-4fe4-9471-49eaa343c828 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1806 microversion: 2.20 time: 0.225147 Jul 04 10:11:31.450304 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 178/361] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:31 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1806 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:32.468849 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-108a2fea-e3a2-4ecf-bdcb-3d97fa06698f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:32.470407 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-108a2fea-e3a2-4ecf-bdcb-3d97fa06698f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:32.484901 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=60 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:32.490164 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-108a2fea-e3a2-4ecf-bdcb-3d97fa06698f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:32.490819 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-108a2fea-e3a2-4ecf-bdcb-3d97fa06698f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:32.491900 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-108a2fea-e3a2-4ecf-bdcb-3d97fa06698f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:32.493242 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-108a2fea-e3a2-4ecf-bdcb-3d97fa06698f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:32.785008 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-108a2fea-e3a2-4ecf-bdcb-3d97fa06698f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:32.796099 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-108a2fea-e3a2-4ecf-bdcb-3d97fa06698f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:32.803974 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-108a2fea-e3a2-4ecf-bdcb-3d97fa06698f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:32.805492 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-108a2fea-e3a2-4ecf-bdcb-3d97fa06698f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1806 microversion: 2.20 time: 0.340943 Jul 04 10:11:32.818760 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 184/362] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:32 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1806 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:33.837847 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-046fd7ab-69e4-4b3d-9d01-e7c28663f5fb tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:33.839129 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-046fd7ab-69e4-4b3d-9d01-e7c28663f5fb tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:33.854719 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-046fd7ab-69e4-4b3d-9d01-e7c28663f5fb tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:33.856726 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-046fd7ab-69e4-4b3d-9d01-e7c28663f5fb tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:33.861358 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-046fd7ab-69e4-4b3d-9d01-e7c28663f5fb tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:33.862834 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-046fd7ab-69e4-4b3d-9d01-e7c28663f5fb tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:33.888536 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:34.365172 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-046fd7ab-69e4-4b3d-9d01-e7c28663f5fb tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:34.384794 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-046fd7ab-69e4-4b3d-9d01-e7c28663f5fb tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:34.386463 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-046fd7ab-69e4-4b3d-9d01-e7c28663f5fb tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:34.387659 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-046fd7ab-69e4-4b3d-9d01-e7c28663f5fb tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1806 microversion: 2.20 time: 0.554863 Jul 04 10:11:34.411284 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 179/363] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:33 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1806 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:35.424248 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-be00fbe4-f176-428a-8631-1fa324e9366a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:35.429125 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-be00fbe4-f176-428a-8631-1fa324e9366a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:35.448996 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-be00fbe4-f176-428a-8631-1fa324e9366a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:35.454773 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-be00fbe4-f176-428a-8631-1fa324e9366a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:35.456181 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-be00fbe4-f176-428a-8631-1fa324e9366a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:35.456801 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-be00fbe4-f176-428a-8631-1fa324e9366a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:36.097936 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-be00fbe4-f176-428a-8631-1fa324e9366a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:36.117338 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-be00fbe4-f176-428a-8631-1fa324e9366a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:36.154882 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-be00fbe4-f176-428a-8631-1fa324e9366a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:36.171618 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-be00fbe4-f176-428a-8631-1fa324e9366a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1806 microversion: 2.20 time: 0.754928 Jul 04 10:11:36.172231 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 185/364] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:35 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1806 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:37.196538 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-f3c24b9a-f4cc-450d-8935-1b3a070260cc tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:37.198048 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-f3c24b9a-f4cc-450d-8935-1b3a070260cc tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:37.211328 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_api:SELECT=36 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:37.213314 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f3c24b9a-f4cc-450d-8935-1b3a070260cc tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:37.214127 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f3c24b9a-f4cc-450d-8935-1b3a070260cc tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:37.225886 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f3c24b9a-f4cc-450d-8935-1b3a070260cc tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:37.226541 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f3c24b9a-f4cc-450d-8935-1b3a070260cc tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:37.549717 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-f3c24b9a-f4cc-450d-8935-1b3a070260cc tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:37.562507 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-f3c24b9a-f4cc-450d-8935-1b3a070260cc tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:37.568289 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-f3c24b9a-f4cc-450d-8935-1b3a070260cc tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:37.569871 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-f3c24b9a-f4cc-450d-8935-1b3a070260cc tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1806 microversion: 2.20 time: 0.378844 Jul 04 10:11:37.573136 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 180/365] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:37 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1806 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:38.594640 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-a218fc2f-f816-4b9a-9080-cf08e11ffebe tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:38.596990 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-a218fc2f-f816-4b9a-9080-cf08e11ffebe tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:38.606847 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a218fc2f-f816-4b9a-9080-cf08e11ffebe tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:38.607660 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a218fc2f-f816-4b9a-9080-cf08e11ffebe tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:38.609161 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a218fc2f-f816-4b9a-9080-cf08e11ffebe tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:38.609838 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a218fc2f-f816-4b9a-9080-cf08e11ffebe tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:38.831620 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-a218fc2f-f816-4b9a-9080-cf08e11ffebe tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:38.840598 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-a218fc2f-f816-4b9a-9080-cf08e11ffebe tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:38.842956 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-a218fc2f-f816-4b9a-9080-cf08e11ffebe tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:38.844356 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-a218fc2f-f816-4b9a-9080-cf08e11ffebe tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1806 microversion: 2.20 time: 0.257535 Jul 04 10:11:38.855641 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 186/366] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:38 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1806 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:39.870457 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-dec15cd7-55b1-4be1-8c99-e9618648ca2e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:39.871778 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-dec15cd7-55b1-4be1-8c99-e9618648ca2e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:39.891296 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-dec15cd7-55b1-4be1-8c99-e9618648ca2e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:39.892029 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-dec15cd7-55b1-4be1-8c99-e9618648ca2e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:39.909492 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-dec15cd7-55b1-4be1-8c99-e9618648ca2e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:39.909960 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-dec15cd7-55b1-4be1-8c99-e9618648ca2e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:40.147743 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-dec15cd7-55b1-4be1-8c99-e9618648ca2e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:40.163107 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-dec15cd7-55b1-4be1-8c99-e9618648ca2e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:40.164598 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-dec15cd7-55b1-4be1-8c99-e9618648ca2e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:40.165809 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-dec15cd7-55b1-4be1-8c99-e9618648ca2e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1806 microversion: 2.20 time: 0.307115 Jul 04 10:11:40.166374 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 187/367] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:39 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1806 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:40.272716 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-2f2143b8-81a2-4338-abe0-a1d88afcbb32 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Action: 'create', calling method: .version_select at 0x7f2808199040>, body: {"keypair": {"name": "tempest-TestShelveInstance-794705669", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJC4Lp+gnEaqiu3Xp6uniUQxTkpEwpD8gXaJN0XlZMpH4gotXdF+c1D8Xq27egWw19VMMpSiNM1/0/89FKTvwusF5Yzg0JO4AEMvMfBiKuxpwsspzcr+fKIlnR3vo3XGGA=="}} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:11:40.323713 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.quota [None req-2f2143b8-81a2-4338-abe0-a1d88afcbb32 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Getting quotas for project f8d7bb97464d4807a6b7bbac9a41dc67. Resources: {'key_pairs'} {{(pid=117866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 10:11:40.332018 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.quota [None req-2f2143b8-81a2-4338-abe0-a1d88afcbb32 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Getting quotas for user f7c009e1bcd74151ad3fa95c68916329 and project f8d7bb97464d4807a6b7bbac9a41dc67. Resources: {'key_pairs'} {{(pid=117866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 10:11:40.365580 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-2f2143b8-81a2-4338-abe0-a1d88afcbb32 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.626630 Jul 04 10:11:40.366936 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 181/368] 10.222.0.79 () {60 vars in 1158 bytes} [Mon Jul 4 10:11:39 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:11:41.184005 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f4381846-2e36-48ba-bac0-607f442b5c24 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:41.185426 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f4381846-2e36-48ba-bac0-607f442b5c24 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:41.192349 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f4381846-2e36-48ba-bac0-607f442b5c24 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:41.192795 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f4381846-2e36-48ba-bac0-607f442b5c24 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:41.193560 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f4381846-2e36-48ba-bac0-607f442b5c24 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:41.194020 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f4381846-2e36-48ba-bac0-607f442b5c24 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:41.380769 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-f4381846-2e36-48ba-bac0-607f442b5c24 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:41.391638 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-f4381846-2e36-48ba-bac0-607f442b5c24 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:41.393698 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-f4381846-2e36-48ba-bac0-607f442b5c24 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:41.394881 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f4381846-2e36-48ba-bac0-607f442b5c24 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1806 microversion: 2.20 time: 0.214951 Jul 04 10:11:41.395445 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 188/369] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:41 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1806 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:42.412803 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-9909085e-1247-41b0-be8a-ea807d941249 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:42.413447 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-9909085e-1247-41b0-be8a-ea807d941249 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:42.419999 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9909085e-1247-41b0-be8a-ea807d941249 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:42.420446 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9909085e-1247-41b0-be8a-ea807d941249 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:42.421230 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9909085e-1247-41b0-be8a-ea807d941249 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:42.421942 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9909085e-1247-41b0-be8a-ea807d941249 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:42.586291 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-9909085e-1247-41b0-be8a-ea807d941249 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:42.597906 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-9909085e-1247-41b0-be8a-ea807d941249 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:42.599986 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-9909085e-1247-41b0-be8a-ea807d941249 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:42.602462 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-9909085e-1247-41b0-be8a-ea807d941249 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1806 microversion: 2.20 time: 0.193767 Jul 04 10:11:42.603888 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 182/370] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:42 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1806 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:43.621154 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-d1e623f5-3bc2-4a05-bc70-bf27b5f3e8dd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:43.622517 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d1e623f5-3bc2-4a05-bc70-bf27b5f3e8dd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:43.630680 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d1e623f5-3bc2-4a05-bc70-bf27b5f3e8dd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:43.631135 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d1e623f5-3bc2-4a05-bc70-bf27b5f3e8dd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:43.631913 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d1e623f5-3bc2-4a05-bc70-bf27b5f3e8dd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:43.632557 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d1e623f5-3bc2-4a05-bc70-bf27b5f3e8dd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:43.779694 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-d1e623f5-3bc2-4a05-bc70-bf27b5f3e8dd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:43.789453 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-d1e623f5-3bc2-4a05-bc70-bf27b5f3e8dd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:43.791143 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-d1e623f5-3bc2-4a05-bc70-bf27b5f3e8dd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:43.792639 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-d1e623f5-3bc2-4a05-bc70-bf27b5f3e8dd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1806 microversion: 2.20 time: 0.175688 Jul 04 10:11:43.793291 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 189/371] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:43 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1806 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:44.811638 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-3b74f6db-4904-4e96-83ed-7bd2193f8dde tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:44.812259 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-3b74f6db-4904-4e96-83ed-7bd2193f8dde tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:44.818974 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3b74f6db-4904-4e96-83ed-7bd2193f8dde tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:44.819421 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3b74f6db-4904-4e96-83ed-7bd2193f8dde tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:44.820209 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3b74f6db-4904-4e96-83ed-7bd2193f8dde tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:44.820638 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3b74f6db-4904-4e96-83ed-7bd2193f8dde tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:44.954429 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-3b74f6db-4904-4e96-83ed-7bd2193f8dde tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:44.963131 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-3b74f6db-4904-4e96-83ed-7bd2193f8dde tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:44.964963 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-3b74f6db-4904-4e96-83ed-7bd2193f8dde tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:44.966307 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-3b74f6db-4904-4e96-83ed-7bd2193f8dde tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1806 microversion: 2.20 time: 0.158620 Jul 04 10:11:44.966889 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 183/372] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:44 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:45.986039 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f40e0c50-540e-44e7-b7f9-e6b161cbe512 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:45.986799 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f40e0c50-540e-44e7-b7f9-e6b161cbe512 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:45.996028 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f40e0c50-540e-44e7-b7f9-e6b161cbe512 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:46.001292 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f40e0c50-540e-44e7-b7f9-e6b161cbe512 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:46.001292 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f40e0c50-540e-44e7-b7f9-e6b161cbe512 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:46.001292 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f40e0c50-540e-44e7-b7f9-e6b161cbe512 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:46.141195 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-f40e0c50-540e-44e7-b7f9-e6b161cbe512 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:46.152314 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-f40e0c50-540e-44e7-b7f9-e6b161cbe512 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:46.154264 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-f40e0c50-540e-44e7-b7f9-e6b161cbe512 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:46.155462 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f40e0c50-540e-44e7-b7f9-e6b161cbe512 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1806 microversion: 2.20 time: 0.174437 Jul 04 10:11:46.158028 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 190/373] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:45 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1806 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 10:11:47.174669 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-a03b21f9-71dc-485a-86b6-7909f249739a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:47.175319 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-a03b21f9-71dc-485a-86b6-7909f249739a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:47.182025 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a03b21f9-71dc-485a-86b6-7909f249739a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:47.182471 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a03b21f9-71dc-485a-86b6-7909f249739a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:47.183225 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a03b21f9-71dc-485a-86b6-7909f249739a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:47.183653 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a03b21f9-71dc-485a-86b6-7909f249739a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:47.326024 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-a03b21f9-71dc-485a-86b6-7909f249739a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:47.338438 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-a03b21f9-71dc-485a-86b6-7909f249739a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:47.340724 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-a03b21f9-71dc-485a-86b6-7909f249739a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:47.342921 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-a03b21f9-71dc-485a-86b6-7909f249739a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1806 microversion: 2.20 time: 0.171575 Jul 04 10:11:47.343984 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 184/374] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:47 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:48.365836 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f5e0dfd7-3b73-4ac0-b160-1764265da147 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:48.366759 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f5e0dfd7-3b73-4ac0-b160-1764265da147 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:48.377229 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f5e0dfd7-3b73-4ac0-b160-1764265da147 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:48.377970 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f5e0dfd7-3b73-4ac0-b160-1764265da147 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:48.379212 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f5e0dfd7-3b73-4ac0-b160-1764265da147 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:48.379903 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f5e0dfd7-3b73-4ac0-b160-1764265da147 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:48.518773 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-f5e0dfd7-3b73-4ac0-b160-1764265da147 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:48.528991 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-f5e0dfd7-3b73-4ac0-b160-1764265da147 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:48.530608 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-f5e0dfd7-3b73-4ac0-b160-1764265da147 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:48.531874 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f5e0dfd7-3b73-4ac0-b160-1764265da147 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1806 microversion: 2.20 time: 0.171836 Jul 04 10:11:48.532508 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 191/375] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:48 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:49.550648 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-2be4debf-4a0b-4492-a7fa-d386613d9f62 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:49.551248 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-2be4debf-4a0b-4492-a7fa-d386613d9f62 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:49.558153 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2be4debf-4a0b-4492-a7fa-d386613d9f62 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:49.558595 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2be4debf-4a0b-4492-a7fa-d386613d9f62 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:49.559351 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2be4debf-4a0b-4492-a7fa-d386613d9f62 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:49.559773 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2be4debf-4a0b-4492-a7fa-d386613d9f62 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:49.700993 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-2be4debf-4a0b-4492-a7fa-d386613d9f62 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:49.713517 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-2be4debf-4a0b-4492-a7fa-d386613d9f62 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:49.715937 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-2be4debf-4a0b-4492-a7fa-d386613d9f62 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:49.718093 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-2be4debf-4a0b-4492-a7fa-d386613d9f62 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1806 microversion: 2.20 time: 0.170775 Jul 04 10:11:49.718823 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 185/376] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:49 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:50.739562 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-bb08e51a-fcc0-426b-9c8a-a443410f61f3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:50.740170 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-bb08e51a-fcc0-426b-9c8a-a443410f61f3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:50.747238 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bb08e51a-fcc0-426b-9c8a-a443410f61f3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:50.747894 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bb08e51a-fcc0-426b-9c8a-a443410f61f3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:50.748446 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bb08e51a-fcc0-426b-9c8a-a443410f61f3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:50.748888 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bb08e51a-fcc0-426b-9c8a-a443410f61f3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:50.885423 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-bb08e51a-fcc0-426b-9c8a-a443410f61f3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:50.894269 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-bb08e51a-fcc0-426b-9c8a-a443410f61f3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:50.896194 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-bb08e51a-fcc0-426b-9c8a-a443410f61f3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:50.897370 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-bb08e51a-fcc0-426b-9c8a-a443410f61f3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1806 microversion: 2.20 time: 0.161755 Jul 04 10:11:50.900683 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 192/377] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:50 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:51.918021 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-01372b05-0930-4073-9550-6633d9f1a7ce tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:51.918976 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-01372b05-0930-4073-9550-6633d9f1a7ce tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:51.920991 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell0:SELECT=4 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:51.927228 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-01372b05-0930-4073-9550-6633d9f1a7ce tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:51.927670 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-01372b05-0930-4073-9550-6633d9f1a7ce tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:51.928436 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-01372b05-0930-4073-9550-6633d9f1a7ce tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:51.928860 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-01372b05-0930-4073-9550-6633d9f1a7ce tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:52.069585 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-01372b05-0930-4073-9550-6633d9f1a7ce tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:52.078787 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-01372b05-0930-4073-9550-6633d9f1a7ce tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:52.080409 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-01372b05-0930-4073-9550-6633d9f1a7ce tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:52.081585 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-01372b05-0930-4073-9550-6633d9f1a7ce tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1806 microversion: 2.20 time: 0.167653 Jul 04 10:11:52.082166 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 186/378] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:51 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:53.100024 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2e9c2374-59d1-4a47-b8f1-c938e9a82da0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:53.100611 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-2e9c2374-59d1-4a47-b8f1-c938e9a82da0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:53.108365 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2e9c2374-59d1-4a47-b8f1-c938e9a82da0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:53.108813 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2e9c2374-59d1-4a47-b8f1-c938e9a82da0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:53.109591 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2e9c2374-59d1-4a47-b8f1-c938e9a82da0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:53.110053 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2e9c2374-59d1-4a47-b8f1-c938e9a82da0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:53.245446 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-2e9c2374-59d1-4a47-b8f1-c938e9a82da0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:53.254565 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-2e9c2374-59d1-4a47-b8f1-c938e9a82da0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:53.256056 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-2e9c2374-59d1-4a47-b8f1-c938e9a82da0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:53.257218 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-2e9c2374-59d1-4a47-b8f1-c938e9a82da0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1806 microversion: 2.20 time: 0.161217 Jul 04 10:11:53.257833 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 193/379] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:53 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:54.279041 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-f7736553-f3c0-4d32-8fec-1c735cb9588a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:54.279930 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-f7736553-f3c0-4d32-8fec-1c735cb9588a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:54.289707 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f7736553-f3c0-4d32-8fec-1c735cb9588a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:54.290501 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f7736553-f3c0-4d32-8fec-1c735cb9588a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:54.291786 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f7736553-f3c0-4d32-8fec-1c735cb9588a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:54.292501 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f7736553-f3c0-4d32-8fec-1c735cb9588a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:54.431649 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-f7736553-f3c0-4d32-8fec-1c735cb9588a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:54.440882 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-f7736553-f3c0-4d32-8fec-1c735cb9588a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:54.442404 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-f7736553-f3c0-4d32-8fec-1c735cb9588a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:54.443567 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-f7736553-f3c0-4d32-8fec-1c735cb9588a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1806 microversion: 2.20 time: 0.169876 Jul 04 10:11:54.444108 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 187/380] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:54 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:55.466651 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-7289c37c-c0f4-42aa-92fb-916bd1e3cb7a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:55.468071 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-7289c37c-c0f4-42aa-92fb-916bd1e3cb7a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:55.475062 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7289c37c-c0f4-42aa-92fb-916bd1e3cb7a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:55.475510 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7289c37c-c0f4-42aa-92fb-916bd1e3cb7a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:55.476331 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7289c37c-c0f4-42aa-92fb-916bd1e3cb7a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:55.476708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7289c37c-c0f4-42aa-92fb-916bd1e3cb7a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:55.620096 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-7289c37c-c0f4-42aa-92fb-916bd1e3cb7a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:55.628918 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-7289c37c-c0f4-42aa-92fb-916bd1e3cb7a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:55.630456 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-7289c37c-c0f4-42aa-92fb-916bd1e3cb7a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:55.631596 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-7289c37c-c0f4-42aa-92fb-916bd1e3cb7a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1806 microversion: 2.20 time: 0.171668 Jul 04 10:11:55.632143 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 194/381] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:55 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:56.057312 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-23a9f584-e350-4f4e-a8e4-8c8a3bfabc66 req-fac21ec0-12ab-41a3-bc5c-c01aed648e03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2", "name": "network-vif-plugged", "status": "completed", "tag": "ca00e905-cd23-4f89-b9a3-2e4d9b7e6b31"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:11:56.068461 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-23a9f584-e350-4f4e-a8e4-8c8a3bfabc66 req-fac21ec0-12ab-41a3-bc5c-c01aed648e03 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:56.069299 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-23a9f584-e350-4f4e-a8e4-8c8a3bfabc66 req-fac21ec0-12ab-41a3-bc5c-c01aed648e03 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:56.082685 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-23a9f584-e350-4f4e-a8e4-8c8a3bfabc66 req-fac21ec0-12ab-41a3-bc5c-c01aed648e03 service nova] Creating event network-vif-plugged:ca00e905-cd23-4f89-b9a3-2e4d9b7e6b31 for instance ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 on hv-cinder-84841 Jul 04 10:11:56.087952 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-23a9f584-e350-4f4e-a8e4-8c8a3bfabc66 req-fac21ec0-12ab-41a3-bc5c-c01aed648e03 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034412 Jul 04 10:11:56.088571 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 188/382] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:11:56.650034 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-012f7c1c-5423-4e44-b130-22894c8c7e9f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:56.650766 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-012f7c1c-5423-4e44-b130-22894c8c7e9f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:56.657488 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-012f7c1c-5423-4e44-b130-22894c8c7e9f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:56.657959 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-012f7c1c-5423-4e44-b130-22894c8c7e9f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:56.658680 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-012f7c1c-5423-4e44-b130-22894c8c7e9f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:56.659103 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-012f7c1c-5423-4e44-b130-22894c8c7e9f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:56.800103 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-012f7c1c-5423-4e44-b130-22894c8c7e9f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:56.812705 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-012f7c1c-5423-4e44-b130-22894c8c7e9f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:56.814240 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-012f7c1c-5423-4e44-b130-22894c8c7e9f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:56.815391 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-012f7c1c-5423-4e44-b130-22894c8c7e9f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1806 microversion: 2.20 time: 0.169389 Jul 04 10:11:56.815949 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 195/383] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:56 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:57.844111 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-a67814a8-8408-484c-9dc8-715d5f127609 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:57.844719 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-a67814a8-8408-484c-9dc8-715d5f127609 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:57.851663 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a67814a8-8408-484c-9dc8-715d5f127609 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:57.852101 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a67814a8-8408-484c-9dc8-715d5f127609 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:57.852845 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a67814a8-8408-484c-9dc8-715d5f127609 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:57.853265 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a67814a8-8408-484c-9dc8-715d5f127609 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:57.992865 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-a67814a8-8408-484c-9dc8-715d5f127609 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:58.002152 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-a67814a8-8408-484c-9dc8-715d5f127609 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:58.003632 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-a67814a8-8408-484c-9dc8-715d5f127609 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:58.004799 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-a67814a8-8408-484c-9dc8-715d5f127609 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1806 microversion: 2.20 time: 0.168044 Jul 04 10:11:58.005326 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 189/384] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:57 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:59.025548 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-c152035d-f9d7-491d-97e3-b4409c50c163 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:59.026208 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-c152035d-f9d7-491d-97e3-b4409c50c163 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:59.034514 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c152035d-f9d7-491d-97e3-b4409c50c163 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:59.035065 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c152035d-f9d7-491d-97e3-b4409c50c163 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:59.035932 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c152035d-f9d7-491d-97e3-b4409c50c163 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:59.036450 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c152035d-f9d7-491d-97e3-b4409c50c163 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:59.174587 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-c152035d-f9d7-491d-97e3-b4409c50c163 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:59.183415 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-c152035d-f9d7-491d-97e3-b4409c50c163 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:59.184875 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-c152035d-f9d7-491d-97e3-b4409c50c163 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:11:59.186079 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-c152035d-f9d7-491d-97e3-b4409c50c163 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1793 microversion: 2.20 time: 0.166628 Jul 04 10:11:59.186639 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 196/385] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:11:59 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1793 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:11:59.207440 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-d0e33970-62ce-4158-80f0-b83b5dde67b7 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-940866967", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-794705669", "security_groups": [{"name": "tempest-secgroup-smoke-276727674"}], "networks": [{"uuid": "ce6e6105-a549-4580-b0f7-630aadbb2dbf"}], "block_device_mapping_v2": [{"uuid": "40efda16-247f-43c9-8233-aa14114d19a0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:11:59.324959 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.network.neutron [None req-d0e33970-62ce-4158-80f0-b83b5dde67b7 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] validate_networks() for [('ce6e6105-a549-4580-b0f7-630aadbb2dbf', None, None, None, None, None)] {{(pid=117866) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 10:11:59.496698 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-ae47f6e7-c257-47a4-a9e0-c01d5cc93f9e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:59.497178 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-ae47f6e7-c257-47a4-a9e0-c01d5cc93f9e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:11:59.503989 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ae47f6e7-c257-47a4-a9e0-c01d5cc93f9e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:59.504424 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ae47f6e7-c257-47a4-a9e0-c01d5cc93f9e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:59.505186 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ae47f6e7-c257-47a4-a9e0-c01d5cc93f9e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:59.505595 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ae47f6e7-c257-47a4-a9e0-c01d5cc93f9e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:59.629193 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.objects.instance [None req-ae47f6e7-c257-47a4-a9e0-c01d5cc93f9e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lazy-loading 'services' on Instance uuid a842f878-2275-4988-8e51-b3b7276678e7 {{(pid=117865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 10:11:59.706967 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-d0e33970-62ce-4158-80f0-b83b5dde67b7 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Flavor limits 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 10:11:59.707391 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-d0e33970-62ce-4158-80f0-b83b5dde67b7 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Image limits 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 10:11:59.708602 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-d0e33970-62ce-4158-80f0-b83b5dde67b7 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Flavor pref 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 10:11:59.709015 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-d0e33970-62ce-4158-80f0-b83b5dde67b7 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Image pref 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 10:11:59.709420 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-d0e33970-62ce-4158-80f0-b83b5dde67b7 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 10:11:59.719435 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d0e33970-62ce-4158-80f0-b83b5dde67b7 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:59.719883 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d0e33970-62ce-4158-80f0-b83b5dde67b7 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:59.720679 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d0e33970-62ce-4158-80f0-b83b5dde67b7 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:11:59.721108 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d0e33970-62ce-4158-80f0-b83b5dde67b7 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:11:59.740184 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.quota [None req-d0e33970-62ce-4158-80f0-b83b5dde67b7 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Getting quotas for project f8d7bb97464d4807a6b7bbac9a41dc67. Resources: {'cores', 'ram', 'instances'} {{(pid=117866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 10:11:59.744845 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.quota [None req-d0e33970-62ce-4158-80f0-b83b5dde67b7 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Getting quotas for user f7c009e1bcd74151ad3fa95c68916329 and project f8d7bb97464d4807a6b7bbac9a41dc67. Resources: {'cores', 'ram', 'instances'} {{(pid=117866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 10:11:59.747038 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-ae47f6e7-c257-47a4-a9e0-c01d5cc93f9e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7/os-volume_attachments/31799a2a-3fed-4b86-ba34-2f4e8154195a" status: 202 len: 0 microversion: 2.1 time: 0.254151 Jul 04 10:11:59.747617 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 197/386] 10.222.0.79 () {58 vars in 1415 bytes} [Mon Jul 4 10:11:59 2022] DELETE /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7/os-volume_attachments/31799a2a-3fed-4b86-ba34-2f4e8154195a => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 10:11:59.806763 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-d0e33970-62ce-4158-80f0-b83b5dde67b7 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Going to run 1 instances... {{(pid=117866) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 10:11:59.808910 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-d0e33970-62ce-4158-80f0-b83b5dde67b7 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='40efda16-247f-43c9-8233-aa14114d19a0',volume_size=None,volume_type=None)] {{(pid=117866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 10:11:59.941735 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-d0e33970-62ce-4158-80f0-b83b5dde67b7 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.738939 Jul 04 10:11:59.942438 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 190/387] 10.222.0.79 () {60 vars in 1146 bytes} [Mon Jul 4 10:11:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 10:11:59.953282 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-40f21901-1d36-452d-b6e6-a2b839ed4eeb tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:11:59.954026 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-40f21901-1d36-452d-b6e6-a2b839ed4eeb tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:00.008323 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-40f21901-1d36-452d-b6e6-a2b839ed4eeb tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:00.015824 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-40f21901-1d36-452d-b6e6-a2b839ed4eeb tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1087 microversion: 2.1 time: 0.066832 Jul 04 10:12:00.016364 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 198/388] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:11:59 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1087 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:00.868363 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-cff8f388-9363-4436-a992-71ce279115fc tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:12:00.875474 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-cff8f388-9363-4436-a992-71ce279115fc tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:00.875914 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-cff8f388-9363-4436-a992-71ce279115fc tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:00.897400 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-cff8f388-9363-4436-a992-71ce279115fc tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Going to try to stop instance {{(pid=117866) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 04 10:12:00.947824 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-cff8f388-9363-4436-a992-71ce279115fc tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "POST /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7/action" status: 202 len: 0 microversion: 2.1 time: 0.083173 Jul 04 10:12:00.948633 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 191/389] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Jul 4 10:12:00 2022] POST /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 10:12:00.956788 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-c35d545e-9b4f-49e5-821f-b2578f697041 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:00.958662 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-c35d545e-9b4f-49e5-821f-b2578f697041 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:00.966019 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c35d545e-9b4f-49e5-821f-b2578f697041 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:00.966551 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c35d545e-9b4f-49e5-821f-b2578f697041 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:00.967928 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c35d545e-9b4f-49e5-821f-b2578f697041 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:00.968485 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c35d545e-9b4f-49e5-821f-b2578f697041 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:01.034177 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-28db9a97-a544-4e1f-9fd6-6d04e3078d8d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:01.035095 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-28db9a97-a544-4e1f-9fd6-6d04e3078d8d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:01.041525 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-28db9a97-a544-4e1f-9fd6-6d04e3078d8d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:01.041947 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-28db9a97-a544-4e1f-9fd6-6d04e3078d8d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:01.042799 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-28db9a97-a544-4e1f-9fd6-6d04e3078d8d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:01.043232 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-28db9a97-a544-4e1f-9fd6-6d04e3078d8d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:01.173273 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-28db9a97-a544-4e1f-9fd6-6d04e3078d8d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:01.183037 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-28db9a97-a544-4e1f-9fd6-6d04e3078d8d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1193 microversion: 2.1 time: 0.153040 Jul 04 10:12:01.184014 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 192/390] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:01 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1193 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:12:01.208043 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-c35d545e-9b4f-49e5-821f-b2578f697041 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:01.216014 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-c35d545e-9b4f-49e5-821f-b2578f697041 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1677 microversion: 2.1 time: 0.262847 Jul 04 10:12:01.216795 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 199/391] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:00 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1677 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:02.200568 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-dfe4397a-97bc-4e19-8443-77060f085f8c tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:02.201145 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-dfe4397a-97bc-4e19-8443-77060f085f8c tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:02.208052 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-dfe4397a-97bc-4e19-8443-77060f085f8c tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:02.208662 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-dfe4397a-97bc-4e19-8443-77060f085f8c tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:02.209434 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-dfe4397a-97bc-4e19-8443-77060f085f8c tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:02.209890 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-dfe4397a-97bc-4e19-8443-77060f085f8c tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:02.234691 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-c1b4faf2-d4f9-4e63-8421-b7ef0f369c90 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:02.235698 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-c1b4faf2-d4f9-4e63-8421-b7ef0f369c90 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:02.242953 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c1b4faf2-d4f9-4e63-8421-b7ef0f369c90 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:02.243687 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c1b4faf2-d4f9-4e63-8421-b7ef0f369c90 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:02.244422 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c1b4faf2-d4f9-4e63-8421-b7ef0f369c90 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:02.244941 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c1b4faf2-d4f9-4e63-8421-b7ef0f369c90 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:02.528148 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-dfe4397a-97bc-4e19-8443-77060f085f8c tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:02.532811 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-c1b4faf2-d4f9-4e63-8421-b7ef0f369c90 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:02.535236 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:12:02.537015 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-dfe4397a-97bc-4e19-8443-77060f085f8c tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1258 microversion: 2.1 time: 0.340303 Jul 04 10:12:02.537809 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 193/392] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:02 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1258 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:02.542268 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-c1b4faf2-d4f9-4e63-8421-b7ef0f369c90 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1677 microversion: 2.1 time: 0.311530 Jul 04 10:12:02.542928 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 200/393] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:02 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1677 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:02.953956 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-473b29f2-8aaf-481e-8823-55988604e1c1 req-433bdda6-5ec9-476a-9423-f857a50ca361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9526d9a-e0e4-4708-a2da-872d57732128", "tag": "0561989e-f05a-46b1-a7cf-00085ff7229a"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:12:02.970963 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-473b29f2-8aaf-481e-8823-55988604e1c1 req-433bdda6-5ec9-476a-9423-f857a50ca361 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:02.971797 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-473b29f2-8aaf-481e-8823-55988604e1c1 req-433bdda6-5ec9-476a-9423-f857a50ca361 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:02.991525 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-473b29f2-8aaf-481e-8823-55988604e1c1 req-433bdda6-5ec9-476a-9423-f857a50ca361 service nova] Creating event network-changed:0561989e-f05a-46b1-a7cf-00085ff7229a for instance f9526d9a-e0e4-4708-a2da-872d57732128 on hv-cinder-84841 Jul 04 10:12:02.998488 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-473b29f2-8aaf-481e-8823-55988604e1c1 req-433bdda6-5ec9-476a-9423-f857a50ca361 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047236 Jul 04 10:12:02.999502 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 194/394] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:12:03.558460 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b6fa45e3-facf-4e94-b5ff-80564df76b14 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:03.559326 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-b6fa45e3-facf-4e94-b5ff-80564df76b14 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:03.562782 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=36 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:12:03.565031 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-2a6c8dac-81e2-47b1-b736-a577649c800c tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:03.566375 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-2a6c8dac-81e2-47b1-b736-a577649c800c tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:03.571015 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b6fa45e3-facf-4e94-b5ff-80564df76b14 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:03.571495 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b6fa45e3-facf-4e94-b5ff-80564df76b14 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:03.572626 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b6fa45e3-facf-4e94-b5ff-80564df76b14 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:03.573072 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b6fa45e3-facf-4e94-b5ff-80564df76b14 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:03.573236 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2a6c8dac-81e2-47b1-b736-a577649c800c tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:03.573714 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2a6c8dac-81e2-47b1-b736-a577649c800c tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:03.574471 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2a6c8dac-81e2-47b1-b736-a577649c800c tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:03.574900 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2a6c8dac-81e2-47b1-b736-a577649c800c tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:03.831999 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-b6fa45e3-facf-4e94-b5ff-80564df76b14 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:03.837122 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-2a6c8dac-81e2-47b1-b736-a577649c800c tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:03.840314 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-b6fa45e3-facf-4e94-b5ff-80564df76b14 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1258 microversion: 2.1 time: 0.288170 Jul 04 10:12:03.841110 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 201/395] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:03 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1258 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:03.845352 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-2a6c8dac-81e2-47b1-b736-a577649c800c tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1677 microversion: 2.1 time: 0.286675 Jul 04 10:12:03.845941 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 195/396] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:03 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1677 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:04.866827 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-482d8c28-ae94-4dd7-87fc-9cc35433bf1a tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:04.867388 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-33c77f8d-0824-4d10-b77f-8837989d7f34 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:04.867777 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-482d8c28-ae94-4dd7-87fc-9cc35433bf1a tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:04.867870 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-33c77f8d-0824-4d10-b77f-8837989d7f34 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:04.874296 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-482d8c28-ae94-4dd7-87fc-9cc35433bf1a tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:04.874454 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-33c77f8d-0824-4d10-b77f-8837989d7f34 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:04.874749 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-482d8c28-ae94-4dd7-87fc-9cc35433bf1a tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:04.874893 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-33c77f8d-0824-4d10-b77f-8837989d7f34 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:04.875521 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-482d8c28-ae94-4dd7-87fc-9cc35433bf1a tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:04.875665 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-33c77f8d-0824-4d10-b77f-8837989d7f34 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:04.875952 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-482d8c28-ae94-4dd7-87fc-9cc35433bf1a tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:04.876094 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-33c77f8d-0824-4d10-b77f-8837989d7f34 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:04.878608 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:12:05.081162 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-482d8c28-ae94-4dd7-87fc-9cc35433bf1a tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:05.084768 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-33c77f8d-0824-4d10-b77f-8837989d7f34 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:05.089113 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-482d8c28-ae94-4dd7-87fc-9cc35433bf1a tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1258 microversion: 2.1 time: 0.226791 Jul 04 10:12:05.089715 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 202/397] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:04 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1258 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:05.092941 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-33c77f8d-0824-4d10-b77f-8837989d7f34 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1677 microversion: 2.1 time: 0.229809 Jul 04 10:12:05.093580 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 196/398] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:04 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1677 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:05.413791 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-0370ba74-bf8e-4aba-ad66-36d9e5a0bb48 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:05.414477 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-0370ba74-bf8e-4aba-ad66-36d9e5a0bb48 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 13a952ca-c64f-4b22-89d3-3911935ee74d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:05.425247 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0370ba74-bf8e-4aba-ad66-36d9e5a0bb48 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:05.426042 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0370ba74-bf8e-4aba-ad66-36d9e5a0bb48 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:05.427227 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0370ba74-bf8e-4aba-ad66-36d9e5a0bb48 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:05.427665 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0370ba74-bf8e-4aba-ad66-36d9e5a0bb48 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:05.450714 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-0370ba74-bf8e-4aba-ad66-36d9e5a0bb48 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d/ips" status: 200 len: 148 microversion: 2.1 time: 0.043769 Jul 04 10:12:05.451286 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 203/399] 10.222.0.79 () {58 vars in 1247 bytes} [Mon Jul 4 10:12:05 2022] GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d/ips => generated 148 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:12:05.463618 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-8801e2e7-76bd-4665-b6d4-774a99a1fa4a tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17330f0e-d0ee-4eb0-a0a0-1258d7164424"}} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:12:05.465229 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-8801e2e7-76bd-4665-b6d4-774a99a1fa4a tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 13a952ca-c64f-4b22-89d3-3911935ee74d] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:05.474828 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8801e2e7-76bd-4665-b6d4-774a99a1fa4a tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:05.475449 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8801e2e7-76bd-4665-b6d4-774a99a1fa4a tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:05.476614 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8801e2e7-76bd-4665-b6d4-774a99a1fa4a tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:05.477251 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8801e2e7-76bd-4665-b6d4-774a99a1fa4a tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:05.565260 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.wsgi [None req-8801e2e7-76bd-4665-b6d4-774a99a1fa4a tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] HTTP exception thrown: Invalid volume: volume 17330f0e-d0ee-4eb0-a0a0-1258d7164424 is already attached to instances: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d Jul 04 10:12:05.567088 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-8801e2e7-76bd-4665-b6d4-774a99a1fa4a tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Request method failure captured: Jul 04 10:12:05.567088 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: request: POST /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d/os-volume_attachments HTTP/1.1 Jul 04 10:12:05.567088 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept: application/json Jul 04 10:12:05.567088 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept-Encoding: identity Jul 04 10:12:05.567088 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Connection: close Jul 04 10:12:05.567088 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Length: 74 Jul 04 10:12:05.567088 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Type: application/json Jul 04 10:12:05.567088 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Host: 10.222.0.79 Jul 04 10:12:05.567088 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Openstack-System-Scope: None Jul 04 10:12:05.567088 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: User-Agent: python-urllib3/1.26.9 Jul 04 10:12:05.567088 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Auth-Token: gAAAAABiwrwvD9yiGE4pStEGBF2Ys-pryu1tx1k2auUnE0PRvpPvnRtEQEaHpqZQ8egutal5ICM4nB9U9UkZUlVAaFmujyok7-zJ_4u8OoD2UCOlqV-Oyun1vIdrrzMPcAwbXsLkKDns-0TZYcaWBDNIYObNG0qh5NpdFBBI5iioapUAgXk4vDM Jul 04 10:12:05.567088 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Id: None Jul 04 10:12:05.567088 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Name: None Jul 04 10:12:05.567088 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Identity-Status: Confirmed Jul 04 10:12:05.567088 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Is-Admin-Project: True Jul 04 10:12:05.567088 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Id: default Jul 04 10:12:05.567088 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Name: Default Jul 04 10:12:05.567088 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Id: a57f93d66f534107a228d908afa64890 Jul 04 10:12:05.567088 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Name: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:12:05.567088 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Role: reader,member Jul 04 10:12:05.567088 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Roles: reader,member Jul 04 10:12:05.568807 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a57f93d66f534107a228d908afa64890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a57f93d66f534107a228d908afa64890"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a57f93d66f534107a228d908afa64890"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a57f93d66f534107a228d908afa64890"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:12:05.568807 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:12:05.568807 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Id: a57f93d66f534107a228d908afa64890 Jul 04 10:12:05.568807 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:12:05.568807 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User: tempest-AttachVolumeNegativeTest-223944498-project Jul 04 10:12:05.568807 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Id: default Jul 04 10:12:05.568807 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Name: Default Jul 04 10:12:05.568807 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Id: 88d2351fc3b74ef5a530fded1be6b997 Jul 04 10:12:05.568807 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Name: tempest-AttachVolumeNegativeTest-223944498-project Jul 04 10:12:05.568807 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Jul 04 10:12:05.568807 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {"volumeAttachment": {"volumeId": "17330f0e-d0ee-4eb0-a0a0-1258d7164424"}} Jul 04 10:12:05.568807 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: method: > Jul 04 10:12:05.569809 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: exception: Invalid volume: volume 17330f0e-d0ee-4eb0-a0a0-1258d7164424 is already attached to instances: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d Jul 04 10:12:05.569809 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: action_args: {'server_id': '13a952ca-c64f-4b22-89d3-3911935ee74d', 'body': {'volumeAttachment': {'volumeId': '17330f0e-d0ee-4eb0-a0a0-1258d7164424'}}} Jul 04 10:12:05.569809 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:12:05.569809 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:12:05.569809 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 04 10:12:05.569809 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 04 10:12:05.569809 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 04 10:12:05.569809 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 04 10:12:05.569809 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 04 10:12:05.569809 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 04 10:12:05.569809 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 04 10:12:05.569809 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 04 10:12:05.569809 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 04 10:12:05.569809 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 04 10:12:05.569809 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 17330f0e-d0ee-4eb0-a0a0-1258d7164424 is already attached to instances: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d Jul 04 10:12:05.569809 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:12:05.569809 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:12:05.569809 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:12:05.569809 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:12:05.571398 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:12:05.571398 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:12:05.571398 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:12:05.571398 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:12:05.571398 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:12:05.571398 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:12:05.571398 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 10:12:05.571398 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 10:12:05.571398 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 10:12:05.571398 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 10:12:05.571398 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 10:12:05.571398 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 10:12:05.571398 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 04 10:12:05.571398 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 04 10:12:05.571398 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 17330f0e-d0ee-4eb0-a0a0-1258d7164424 is already attached to instances: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d Jul 04 10:12:05.571398 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:12:05.571398 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:12:05.571398 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:12:05.571398 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:12:05.571398 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:12:05.573319 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:12:05.573319 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:12:05.573319 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:12:05.573319 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 17330f0e-d0ee-4eb0-a0a0-1258d7164424 is already attached to instances: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d Jul 04 10:12:05.573319 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:12:05.573319 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-8801e2e7-76bd-4665-b6d4-774a99a1fa4a tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Returning 400 to user: Invalid volume: volume 17330f0e-d0ee-4eb0-a0a0-1258d7164424 is already attached to instances: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d {{(pid=117866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:12:05.573319 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-8801e2e7-76bd-4665-b6d4-774a99a1fa4a tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "POST /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110384 Jul 04 10:12:05.573319 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 197/400] 10.222.0.79 () {60 vars in 1322 bytes} [Mon Jul 4 10:12:05 2022] POST /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 04 10:12:05.581074 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-09b11c15-ff90-480b-a410-3f5eb593051c tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:05.581808 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-09b11c15-ff90-480b-a410-3f5eb593051c tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 13a952ca-c64f-4b22-89d3-3911935ee74d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:05.588598 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-09b11c15-ff90-480b-a410-3f5eb593051c tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:05.589044 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-09b11c15-ff90-480b-a410-3f5eb593051c tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:05.589857 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-09b11c15-ff90-480b-a410-3f5eb593051c tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:05.590283 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-09b11c15-ff90-480b-a410-3f5eb593051c tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:05.615708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-09b11c15-ff90-480b-a410-3f5eb593051c tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 13a952ca-c64f-4b22-89d3-3911935ee74d] Going to try to terminate instance {{(pid=117865) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 10:12:05.695095 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-09b11c15-ff90-480b-a410-3f5eb593051c tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "DELETE /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d" status: 204 len: 0 microversion: 2.1 time: 0.119933 Jul 04 10:12:05.695953 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 204/401] 10.222.0.79 () {58 vars in 1238 bytes} [Mon Jul 4 10:12:05 2022] DELETE /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 10:12:05.706668 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-7eb11973-6450-4311-870b-c1df574d8ad1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:05.707316 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-7eb11973-6450-4311-870b-c1df574d8ad1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 13a952ca-c64f-4b22-89d3-3911935ee74d] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:05.715793 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7eb11973-6450-4311-870b-c1df574d8ad1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:05.716248 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7eb11973-6450-4311-870b-c1df574d8ad1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:05.717376 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7eb11973-6450-4311-870b-c1df574d8ad1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:05.717840 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7eb11973-6450-4311-870b-c1df574d8ad1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:05.872874 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-7eb11973-6450-4311-870b-c1df574d8ad1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:05.882767 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-7eb11973-6450-4311-870b-c1df574d8ad1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d" status: 200 len: 1681 microversion: 2.1 time: 0.182289 Jul 04 10:12:05.883333 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 198/402] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:05 2022] GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:06.110082 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8380c016-f7e9-43ed-90ce-0f1934978ad4 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:06.110900 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-8380c016-f7e9-43ed-90ce-0f1934978ad4 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:06.111592 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-96a9271f-b8b0-411f-9f7d-1b27dc33e2ac tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:06.112305 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-96a9271f-b8b0-411f-9f7d-1b27dc33e2ac tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:06.118707 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8380c016-f7e9-43ed-90ce-0f1934978ad4 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:06.119144 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8380c016-f7e9-43ed-90ce-0f1934978ad4 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:06.119397 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-96a9271f-b8b0-411f-9f7d-1b27dc33e2ac tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:06.119845 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-96a9271f-b8b0-411f-9f7d-1b27dc33e2ac tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:06.119984 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8380c016-f7e9-43ed-90ce-0f1934978ad4 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:06.120308 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8380c016-f7e9-43ed-90ce-0f1934978ad4 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:06.120606 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-96a9271f-b8b0-411f-9f7d-1b27dc33e2ac tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:06.121031 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-96a9271f-b8b0-411f-9f7d-1b27dc33e2ac tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:06.311909 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-96a9271f-b8b0-411f-9f7d-1b27dc33e2ac tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:06.315419 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-8380c016-f7e9-43ed-90ce-0f1934978ad4 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:06.319831 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-96a9271f-b8b0-411f-9f7d-1b27dc33e2ac tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1677 microversion: 2.1 time: 0.212833 Jul 04 10:12:06.320393 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 199/403] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:06 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1677 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:06.323274 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-8380c016-f7e9-43ed-90ce-0f1934978ad4 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1258 microversion: 2.1 time: 0.218462 Jul 04 10:12:06.323847 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 205/404] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:06 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1258 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:06.904640 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-ef655674-b524-4263-bb0f-e15d3650f8c2 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:06.905566 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-ef655674-b524-4263-bb0f-e15d3650f8c2 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 13a952ca-c64f-4b22-89d3-3911935ee74d] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:06.915690 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ef655674-b524-4263-bb0f-e15d3650f8c2 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:06.916477 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ef655674-b524-4263-bb0f-e15d3650f8c2 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:06.917738 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ef655674-b524-4263-bb0f-e15d3650f8c2 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:06.919058 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ef655674-b524-4263-bb0f-e15d3650f8c2 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:07.060976 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-ef655674-b524-4263-bb0f-e15d3650f8c2 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:07.068561 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-ef655674-b524-4263-bb0f-e15d3650f8c2 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d" status: 200 len: 1681 microversion: 2.1 time: 0.170331 Jul 04 10:12:07.069090 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 200/405] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:06 2022] GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:07.339103 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b04c9f91-7b4d-48c1-abf9-e6132ee91684 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:07.339799 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-b04c9f91-7b4d-48c1-abf9-e6132ee91684 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:07.349228 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-59b0932a-4a2c-45e2-ad23-8a00f5cb2dfd tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:07.350106 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-59b0932a-4a2c-45e2-ad23-8a00f5cb2dfd tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:07.351968 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:12:07.358943 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-59b0932a-4a2c-45e2-ad23-8a00f5cb2dfd tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:07.359419 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-59b0932a-4a2c-45e2-ad23-8a00f5cb2dfd tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:07.359648 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b04c9f91-7b4d-48c1-abf9-e6132ee91684 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:07.360176 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-59b0932a-4a2c-45e2-ad23-8a00f5cb2dfd tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:07.360309 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b04c9f91-7b4d-48c1-abf9-e6132ee91684 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:07.360604 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-59b0932a-4a2c-45e2-ad23-8a00f5cb2dfd tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:07.360987 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b04c9f91-7b4d-48c1-abf9-e6132ee91684 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:07.361593 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b04c9f91-7b4d-48c1-abf9-e6132ee91684 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:07.648402 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-59b0932a-4a2c-45e2-ad23-8a00f5cb2dfd tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:07.655872 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-b04c9f91-7b4d-48c1-abf9-e6132ee91684 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:07.656570 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-59b0932a-4a2c-45e2-ad23-8a00f5cb2dfd tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1258 microversion: 2.1 time: 0.313023 Jul 04 10:12:07.657477 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 201/406] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:07 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1258 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:07.664126 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-b04c9f91-7b4d-48c1-abf9-e6132ee91684 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1677 microversion: 2.1 time: 0.331362 Jul 04 10:12:07.664709 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 206/407] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:07 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1677 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:08.091697 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-2013b9a5-f1a9-4a89-bb99-7f27b0473b62 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:08.092726 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-2013b9a5-f1a9-4a89-bb99-7f27b0473b62 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 13a952ca-c64f-4b22-89d3-3911935ee74d] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:08.099330 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2013b9a5-f1a9-4a89-bb99-7f27b0473b62 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:08.099811 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2013b9a5-f1a9-4a89-bb99-7f27b0473b62 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:08.100580 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2013b9a5-f1a9-4a89-bb99-7f27b0473b62 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:08.101012 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2013b9a5-f1a9-4a89-bb99-7f27b0473b62 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:08.305444 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-2013b9a5-f1a9-4a89-bb99-7f27b0473b62 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:08.313595 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-2013b9a5-f1a9-4a89-bb99-7f27b0473b62 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d" status: 200 len: 1681 microversion: 2.1 time: 0.225612 Jul 04 10:12:08.314225 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 202/408] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:08 2022] GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d => generated 1681 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:08.654569 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-9fc2eaa3-7766-4e24-94e6-43919f0f73b1 req-1ec8ea91-77ee-4a4c-875e-975764786e19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a952ca-c64f-4b22-89d3-3911935ee74d", "name": "network-vif-deleted", "tag": "391d4036-90c2-4805-86d2-58d8be59784d"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:12:08.665050 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-9fc2eaa3-7766-4e24-94e6-43919f0f73b1 req-1ec8ea91-77ee-4a4c-875e-975764786e19 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:08.665485 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-9fc2eaa3-7766-4e24-94e6-43919f0f73b1 req-1ec8ea91-77ee-4a4c-875e-975764786e19 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:08.673713 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-13a66a37-6e8f-47f8-931c-f46895c7cb72 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:08.674644 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-13a66a37-6e8f-47f8-931c-f46895c7cb72 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:08.679582 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-9fc2eaa3-7766-4e24-94e6-43919f0f73b1 req-1ec8ea91-77ee-4a4c-875e-975764786e19 service nova] Creating event network-vif-deleted:391d4036-90c2-4805-86d2-58d8be59784d for instance 13a952ca-c64f-4b22-89d3-3911935ee74d on hv-cinder-84841 Jul 04 10:12:08.683910 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-13a66a37-6e8f-47f8-931c-f46895c7cb72 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:08.684679 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-13a66a37-6e8f-47f8-931c-f46895c7cb72 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:08.685240 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-9fc2eaa3-7766-4e24-94e6-43919f0f73b1 req-1ec8ea91-77ee-4a4c-875e-975764786e19 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034097 Jul 04 10:12:08.686383 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-13a66a37-6e8f-47f8-931c-f46895c7cb72 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:08.686851 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-13a66a37-6e8f-47f8-931c-f46895c7cb72 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:08.689270 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 207/409] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:12:08.697019 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-61dc737c-d6b4-4e0c-80cd-0ecdc48d22c1 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:08.697932 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-61dc737c-d6b4-4e0c-80cd-0ecdc48d22c1 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:08.705012 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-61dc737c-d6b4-4e0c-80cd-0ecdc48d22c1 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:08.705451 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-61dc737c-d6b4-4e0c-80cd-0ecdc48d22c1 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:08.706289 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-61dc737c-d6b4-4e0c-80cd-0ecdc48d22c1 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:08.706720 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-61dc737c-d6b4-4e0c-80cd-0ecdc48d22c1 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:08.890044 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-13a66a37-6e8f-47f8-931c-f46895c7cb72 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:08.900230 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-13a66a37-6e8f-47f8-931c-f46895c7cb72 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1258 microversion: 2.1 time: 0.230796 Jul 04 10:12:08.912791 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 203/410] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:08 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1258 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:08.923729 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-61dc737c-d6b4-4e0c-80cd-0ecdc48d22c1 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:08.932633 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-61dc737c-d6b4-4e0c-80cd-0ecdc48d22c1 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1677 microversion: 2.1 time: 0.241769 Jul 04 10:12:08.933510 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 208/411] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:08 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1677 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:09.331872 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-30060080-5847-4bff-8a6d-4cabfd626c32 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:09.333341 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-30060080-5847-4bff-8a6d-4cabfd626c32 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 13a952ca-c64f-4b22-89d3-3911935ee74d] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:09.340614 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-30060080-5847-4bff-8a6d-4cabfd626c32 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:09.341391 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-30060080-5847-4bff-8a6d-4cabfd626c32 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:09.342582 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-30060080-5847-4bff-8a6d-4cabfd626c32 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:09.343159 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-30060080-5847-4bff-8a6d-4cabfd626c32 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:09.376651 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-30060080-5847-4bff-8a6d-4cabfd626c32 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:09.376870 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-30060080-5847-4bff-8a6d-4cabfd626c32 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:09.377280 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.objects.instance [None req-30060080-5847-4bff-8a6d-4cabfd626c32 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lazy-loading 'fault' on Instance uuid 13a952ca-c64f-4b22-89d3-3911935ee74d {{(pid=117866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 10:12:09.419270 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-30060080-5847-4bff-8a6d-4cabfd626c32 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:09.427547 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-30060080-5847-4bff-8a6d-4cabfd626c32 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d" status: 200 len: 1332 microversion: 2.1 time: 0.099212 Jul 04 10:12:09.428104 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 204/412] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:09 2022] GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d => generated 1332 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:09.804394 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-aa1ebc02-6483-4cb6-8fd9-64e7c0865c9d tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e47af670-35fc-4e8b-a711-288429e75bb4"}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:12:09.805728 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-aa1ebc02-6483-4cb6-8fd9-64e7c0865c9d tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:09.814514 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aa1ebc02-6483-4cb6-8fd9-64e7c0865c9d tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:09.815143 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aa1ebc02-6483-4cb6-8fd9-64e7c0865c9d tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:09.816085 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aa1ebc02-6483-4cb6-8fd9-64e7c0865c9d tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:09.816520 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aa1ebc02-6483-4cb6-8fd9-64e7c0865c9d tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:09.928473 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-ed356011-1e47-435a-898d-a454f131f85f tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:09.929373 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-ed356011-1e47-435a-898d-a454f131f85f tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:09.931941 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell0:SELECT=2 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:12:09.933124 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell0:SELECT=6 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:12:09.941394 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ed356011-1e47-435a-898d-a454f131f85f tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:09.941987 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ed356011-1e47-435a-898d-a454f131f85f tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:09.943210 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ed356011-1e47-435a-898d-a454f131f85f tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:09.945253 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ed356011-1e47-435a-898d-a454f131f85f tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:10.015009 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:12:10.139285 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-aa1ebc02-6483-4cb6-8fd9-64e7c0865c9d tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "POST /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.339840 Jul 04 10:12:10.145160 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 209/413] 10.222.0.79 () {60 vars in 1322 bytes} [Mon Jul 4 10:12:09 2022] POST /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df/os-volume_attachments => generated 194 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:12:10.145925 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-ed356011-1e47-435a-898d-a454f131f85f tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:10.147801 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-d04107a6-e701-42a3-8297-5d38df13de0e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:10.148691 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d04107a6-e701-42a3-8297-5d38df13de0e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:10.149174 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-ed356011-1e47-435a-898d-a454f131f85f tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1258 microversion: 2.1 time: 0.233865 Jul 04 10:12:10.149791 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 205/414] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:09 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1258 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:10.156620 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d04107a6-e701-42a3-8297-5d38df13de0e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:10.157079 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d04107a6-e701-42a3-8297-5d38df13de0e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:10.157917 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d04107a6-e701-42a3-8297-5d38df13de0e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:10.158351 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d04107a6-e701-42a3-8297-5d38df13de0e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:10.307314 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-d04107a6-e701-42a3-8297-5d38df13de0e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:10.318442 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-d04107a6-e701-42a3-8297-5d38df13de0e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1677 microversion: 2.1 time: 0.176883 Jul 04 10:12:10.328722 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 210/415] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:10 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1677 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:10.444635 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-c0590209-821a-47ed-a04e-079263ae386e tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:10.445229 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-c0590209-821a-47ed-a04e-079263ae386e tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 13a952ca-c64f-4b22-89d3-3911935ee74d] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:10.451788 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c0590209-821a-47ed-a04e-079263ae386e tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:10.452226 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c0590209-821a-47ed-a04e-079263ae386e tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:10.452971 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c0590209-821a-47ed-a04e-079263ae386e tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:10.453389 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c0590209-821a-47ed-a04e-079263ae386e tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:10.467587 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.wsgi [None req-c0590209-821a-47ed-a04e-079263ae386e tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] HTTP exception thrown: Instance 13a952ca-c64f-4b22-89d3-3911935ee74d could not be found. Jul 04 10:12:10.469747 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-c0590209-821a-47ed-a04e-079263ae386e tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Request method failure captured: Jul 04 10:12:10.469747 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: request: GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d HTTP/1.1 Jul 04 10:12:10.469747 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept: application/json Jul 04 10:12:10.469747 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept-Encoding: identity Jul 04 10:12:10.469747 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Connection: close Jul 04 10:12:10.469747 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Length: 0 Jul 04 10:12:10.469747 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Type: application/json Jul 04 10:12:10.469747 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Host: 10.222.0.79 Jul 04 10:12:10.469747 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Openstack-System-Scope: None Jul 04 10:12:10.469747 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: User-Agent: python-urllib3/1.26.9 Jul 04 10:12:10.469747 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Auth-Token: gAAAAABiwrwvD9yiGE4pStEGBF2Ys-pryu1tx1k2auUnE0PRvpPvnRtEQEaHpqZQ8egutal5ICM4nB9U9UkZUlVAaFmujyok7-zJ_4u8OoD2UCOlqV-Oyun1vIdrrzMPcAwbXsLkKDns-0TZYcaWBDNIYObNG0qh5NpdFBBI5iioapUAgXk4vDM Jul 04 10:12:10.469747 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Id: None Jul 04 10:12:10.469747 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Name: None Jul 04 10:12:10.469747 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Identity-Status: Confirmed Jul 04 10:12:10.469747 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Is-Admin-Project: True Jul 04 10:12:10.469747 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Id: default Jul 04 10:12:10.469747 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Name: Default Jul 04 10:12:10.469747 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Id: a57f93d66f534107a228d908afa64890 Jul 04 10:12:10.469747 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Name: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:12:10.469747 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Role: reader,member Jul 04 10:12:10.469747 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Roles: reader,member Jul 04 10:12:10.471200 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a57f93d66f534107a228d908afa64890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a57f93d66f534107a228d908afa64890"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a57f93d66f534107a228d908afa64890"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a57f93d66f534107a228d908afa64890"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:12:10.471200 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:12:10.471200 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Id: a57f93d66f534107a228d908afa64890 Jul 04 10:12:10.471200 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:12:10.471200 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User: tempest-AttachVolumeNegativeTest-223944498-project Jul 04 10:12:10.471200 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Id: default Jul 04 10:12:10.471200 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Name: Default Jul 04 10:12:10.471200 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Id: 88d2351fc3b74ef5a530fded1be6b997 Jul 04 10:12:10.471200 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Name: tempest-AttachVolumeNegativeTest-223944498-project Jul 04 10:12:10.471200 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: method: > Jul 04 10:12:10.471200 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: exception: Instance 13a952ca-c64f-4b22-89d3-3911935ee74d could not be found. Jul 04 10:12:10.471200 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: action_args: {'id': '13a952ca-c64f-4b22-89d3-3911935ee74d'} Jul 04 10:12:10.472151 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:12:10.472151 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:12:10.472151 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:12:10.472151 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:12:10.472151 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:12:10.472151 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:12:10.472151 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:12:10.472151 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:12:10.472151 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:12:10.472151 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:12:10.472151 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13a952ca-c64f-4b22-89d3-3911935ee74d could not be found. Jul 04 10:12:10.472151 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:12:10.472151 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:12:10.472151 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:12:10.472151 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:12:10.472151 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:12:10.472151 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:12:10.472151 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:12:10.472151 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:12:10.472151 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:12:10.473706 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:12:10.473706 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 10:12:10.473706 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 10:12:10.473706 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:12:10.473706 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:12:10.473706 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:12:10.473706 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:12:10.473706 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13a952ca-c64f-4b22-89d3-3911935ee74d could not be found. Jul 04 10:12:10.473706 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:12:10.473706 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:12:10.473706 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:12:10.473706 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:12:10.473706 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:12:10.473706 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:12:10.473706 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:12:10.473706 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:12:10.473706 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13a952ca-c64f-4b22-89d3-3911935ee74d could not be found. Jul 04 10:12:10.473706 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:12:10.475758 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-c0590209-821a-47ed-a04e-079263ae386e tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Returning 404 to user: Instance 13a952ca-c64f-4b22-89d3-3911935ee74d could not be found. {{(pid=117866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:12:10.475758 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-c0590209-821a-47ed-a04e-079263ae386e tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d" status: 404 len: 111 microversion: 2.1 time: 0.030501 Jul 04 10:12:10.475758 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 206/416] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:10 2022] GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:12:10.480365 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-9e916e92-05e4-4e00-810e-b5c43103aeef tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '.version_select at 0x7f2808150ee0>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:10.500375 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-9e916e92-05e4-4e00-810e-b5c43103aeef tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1928640362" status: 202 len: 0 microversion: 2.1 time: 0.023788 Jul 04 10:12:10.500948 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 211/417] 10.222.0.79 () {58 vars in 1220 bytes} [Mon Jul 4 10:12:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1928640362 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 10:12:11.166634 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-bfc65435-343c-4e16-8005-026023ad3cbf tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:11.167242 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-bfc65435-343c-4e16-8005-026023ad3cbf tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:11.173360 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-bfc65435-343c-4e16-8005-026023ad3cbf tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:11.173852 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-bfc65435-343c-4e16-8005-026023ad3cbf tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:11.181834 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-bfc65435-343c-4e16-8005-026023ad3cbf tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:11.181834 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-bfc65435-343c-4e16-8005-026023ad3cbf tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:11.190302 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-81b62277-71ba-4fe9-807c-3a1ff7df2e9f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:11.190797 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-81b62277-71ba-4fe9-807c-3a1ff7df2e9f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:11.197175 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-81b62277-71ba-4fe9-807c-3a1ff7df2e9f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:11.197656 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-81b62277-71ba-4fe9-807c-3a1ff7df2e9f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:11.198542 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-81b62277-71ba-4fe9-807c-3a1ff7df2e9f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:11.198973 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-81b62277-71ba-4fe9-807c-3a1ff7df2e9f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:11.291982 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.objects.instance [None req-81b62277-71ba-4fe9-807c-3a1ff7df2e9f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lazy-loading 'services' on Instance uuid 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d {{(pid=117865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 10:12:11.330687 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-bfc65435-343c-4e16-8005-026023ad3cbf tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:11.338262 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-bfc65435-343c-4e16-8005-026023ad3cbf tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1258 microversion: 2.1 time: 0.175682 Jul 04 10:12:11.338836 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 207/418] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:11 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1258 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:12:11.343536 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-ff5e7424-cc37-438b-a984-bf5cd305b3c9 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:11.344128 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-ff5e7424-cc37-438b-a984-bf5cd305b3c9 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:11.350088 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ff5e7424-cc37-438b-a984-bf5cd305b3c9 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:11.350605 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ff5e7424-cc37-438b-a984-bf5cd305b3c9 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:11.351834 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ff5e7424-cc37-438b-a984-bf5cd305b3c9 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:11.352129 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ff5e7424-cc37-438b-a984-bf5cd305b3c9 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:11.370338 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-81b62277-71ba-4fe9-807c-3a1ff7df2e9f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d/os-volume_attachments/17330f0e-d0ee-4eb0-a0a0-1258d7164424" status: 202 len: 0 microversion: 2.1 time: 0.184372 Jul 04 10:12:11.371111 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 212/419] 10.222.0.79 () {58 vars in 1415 bytes} [Mon Jul 4 10:12:11 2022] DELETE /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d/os-volume_attachments/17330f0e-d0ee-4eb0-a0a0-1258d7164424 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 10:12:11.380294 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2faf655e-7725-48bc-a3cc-cb11aadd1c83 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:11.381633 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-2faf655e-7725-48bc-a3cc-cb11aadd1c83 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:11.388160 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2faf655e-7725-48bc-a3cc-cb11aadd1c83 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:11.388790 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2faf655e-7725-48bc-a3cc-cb11aadd1c83 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:11.389644 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2faf655e-7725-48bc-a3cc-cb11aadd1c83 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:11.390217 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2faf655e-7725-48bc-a3cc-cb11aadd1c83 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:11.421126 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-2faf655e-7725-48bc-a3cc-cb11aadd1c83 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045070 Jul 04 10:12:11.425733 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 213/420] 10.222.0.79 () {58 vars in 1301 bytes} [Mon Jul 4 10:12:11 2022] GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:12:11.492439 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-ff5e7424-cc37-438b-a984-bf5cd305b3c9 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:11.500136 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-ff5e7424-cc37-438b-a984-bf5cd305b3c9 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1654 microversion: 2.1 time: 0.160327 Jul 04 10:12:11.500706 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 208/421] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:11 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1654 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:11.520011 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-98b455ac-2da3-4f44-8b18-c1c45e8b2321 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:12:11.528985 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-98b455ac-2da3-4f44-8b18-c1c45e8b2321 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:11.529673 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-98b455ac-2da3-4f44-8b18-c1c45e8b2321 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:11.593271 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-98b455ac-2da3-4f44-8b18-c1c45e8b2321 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Going to try to start instance {{(pid=117865) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 04 10:12:11.628766 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:12:11.642180 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-98b455ac-2da3-4f44-8b18-c1c45e8b2321 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "POST /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7/action" status: 202 len: 0 microversion: 2.1 time: 0.128488 Jul 04 10:12:11.643119 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 214/422] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Jul 4 10:12:11 2022] POST /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 10:12:11.652151 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-eae43725-8f4d-42d2-bf3c-e9f1cb6f2065 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:11.652740 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-eae43725-8f4d-42d2-bf3c-e9f1cb6f2065 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:11.658794 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-eae43725-8f4d-42d2-bf3c-e9f1cb6f2065 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:11.659245 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-eae43725-8f4d-42d2-bf3c-e9f1cb6f2065 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:11.659998 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-eae43725-8f4d-42d2-bf3c-e9f1cb6f2065 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:11.660418 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-eae43725-8f4d-42d2-bf3c-e9f1cb6f2065 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:11.838273 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-eae43725-8f4d-42d2-bf3c-e9f1cb6f2065 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:11.846454 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-eae43725-8f4d-42d2-bf3c-e9f1cb6f2065 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1663 microversion: 2.1 time: 0.198070 Jul 04 10:12:11.847034 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 209/423] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:11 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1663 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:12.355626 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-83d9e783-6456-4f5c-93b7-ff022c39378d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:12.356309 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-83d9e783-6456-4f5c-93b7-ff022c39378d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:12.364503 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-83d9e783-6456-4f5c-93b7-ff022c39378d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:12.364941 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-83d9e783-6456-4f5c-93b7-ff022c39378d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:12.365738 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-83d9e783-6456-4f5c-93b7-ff022c39378d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:12.366237 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-83d9e783-6456-4f5c-93b7-ff022c39378d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:12.434112 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-2aad41cf-39a5-4839-8eab-26e7221b524e tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:12.435420 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-2aad41cf-39a5-4839-8eab-26e7221b524e tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:12.441815 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2aad41cf-39a5-4839-8eab-26e7221b524e tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:12.442318 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2aad41cf-39a5-4839-8eab-26e7221b524e tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:12.443174 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2aad41cf-39a5-4839-8eab-26e7221b524e tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:12.443678 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2aad41cf-39a5-4839-8eab-26e7221b524e tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:12.475627 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-2aad41cf-39a5-4839-8eab-26e7221b524e tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045501 Jul 04 10:12:12.479730 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 210/424] 10.222.0.79 () {58 vars in 1301 bytes} [Mon Jul 4 10:12:12 2022] GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:12:12.507383 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-83d9e783-6456-4f5c-93b7-ff022c39378d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:12.515143 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-83d9e783-6456-4f5c-93b7-ff022c39378d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1258 microversion: 2.1 time: 0.163787 Jul 04 10:12:12.515714 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 215/425] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:12 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:12.868301 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-b5fec3f7-0638-4a67-ac6a-641632cc9092 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:12.869261 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-b5fec3f7-0638-4a67-ac6a-641632cc9092 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:12.879549 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b5fec3f7-0638-4a67-ac6a-641632cc9092 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:12.880302 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b5fec3f7-0638-4a67-ac6a-641632cc9092 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:12.881565 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b5fec3f7-0638-4a67-ac6a-641632cc9092 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:12.882165 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b5fec3f7-0638-4a67-ac6a-641632cc9092 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:13.010794 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-b5fec3f7-0638-4a67-ac6a-641632cc9092 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:13.018980 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-b5fec3f7-0638-4a67-ac6a-641632cc9092 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1663 microversion: 2.1 time: 0.157264 Jul 04 10:12:13.019550 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 211/426] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:12 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1663 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:13.488094 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-bfcdb225-45f9-4637-aa80-b51b9c6c507e tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:13.489055 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-bfcdb225-45f9-4637-aa80-b51b9c6c507e tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:13.496760 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bfcdb225-45f9-4637-aa80-b51b9c6c507e tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:13.497208 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bfcdb225-45f9-4637-aa80-b51b9c6c507e tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:13.498017 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bfcdb225-45f9-4637-aa80-b51b9c6c507e tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:13.498448 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bfcdb225-45f9-4637-aa80-b51b9c6c507e tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:13.530425 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-bfcdb225-45f9-4637-aa80-b51b9c6c507e tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046813 Jul 04 10:12:13.531290 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 216/427] 10.222.0.79 () {58 vars in 1301 bytes} [Mon Jul 4 10:12:13 2022] GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:12:13.536712 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-b5441530-6ba2-4c18-b5fe-0357d49a1f58 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:13.537328 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-b5441530-6ba2-4c18-b5fe-0357d49a1f58 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:13.543728 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b5441530-6ba2-4c18-b5fe-0357d49a1f58 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:13.544169 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b5441530-6ba2-4c18-b5fe-0357d49a1f58 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:13.544963 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b5441530-6ba2-4c18-b5fe-0357d49a1f58 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:13.545385 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b5441530-6ba2-4c18-b5fe-0357d49a1f58 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:13.681936 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-b5441530-6ba2-4c18-b5fe-0357d49a1f58 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:13.690160 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-b5441530-6ba2-4c18-b5fe-0357d49a1f58 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1258 microversion: 2.1 time: 0.161165 Jul 04 10:12:13.690749 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 212/428] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:13 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:14.037720 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5b68a6ce-b7e2-4d0d-80b2-ebe9467c89e0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:14.038327 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-5b68a6ce-b7e2-4d0d-80b2-ebe9467c89e0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:14.044792 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5b68a6ce-b7e2-4d0d-80b2-ebe9467c89e0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:14.045240 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5b68a6ce-b7e2-4d0d-80b2-ebe9467c89e0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:14.046028 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5b68a6ce-b7e2-4d0d-80b2-ebe9467c89e0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:14.046455 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5b68a6ce-b7e2-4d0d-80b2-ebe9467c89e0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:14.150685 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-4a69f561-830f-4190-9054-03c20b56082e req-da9c3773-79ed-4ad4-b5f0-1f08f7424ccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9526d9a-e0e4-4708-a2da-872d57732128", "name": "network-vif-plugged", "status": "completed", "tag": "0561989e-f05a-46b1-a7cf-00085ff7229a"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:12:14.160144 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-4a69f561-830f-4190-9054-03c20b56082e req-da9c3773-79ed-4ad4-b5f0-1f08f7424ccf service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:14.160577 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-4a69f561-830f-4190-9054-03c20b56082e req-da9c3773-79ed-4ad4-b5f0-1f08f7424ccf service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:14.164974 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell1:SELECT=100 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:12:14.173534 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-4a69f561-830f-4190-9054-03c20b56082e req-da9c3773-79ed-4ad4-b5f0-1f08f7424ccf service nova] Creating event network-vif-plugged:0561989e-f05a-46b1-a7cf-00085ff7229a for instance f9526d9a-e0e4-4708-a2da-872d57732128 on hv-cinder-84841 Jul 04 10:12:14.181138 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-5b68a6ce-b7e2-4d0d-80b2-ebe9467c89e0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:14.185275 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-4a69f561-830f-4190-9054-03c20b56082e req-da9c3773-79ed-4ad4-b5f0-1f08f7424ccf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038347 Jul 04 10:12:14.185941 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 213/429] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:12:14.189854 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-5b68a6ce-b7e2-4d0d-80b2-ebe9467c89e0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1667 microversion: 2.1 time: 0.157087 Jul 04 10:12:14.190336 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 217/430] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:14 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1667 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:14.543141 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-5b370f8a-1579-4be3-ae2c-10de34d79d81 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:14.544162 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-5b370f8a-1579-4be3-ae2c-10de34d79d81 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:14.550576 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5b370f8a-1579-4be3-ae2c-10de34d79d81 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:14.551024 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5b370f8a-1579-4be3-ae2c-10de34d79d81 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:14.551773 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5b370f8a-1579-4be3-ae2c-10de34d79d81 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:14.552200 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5b370f8a-1579-4be3-ae2c-10de34d79d81 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:14.581243 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-5b370f8a-1579-4be3-ae2c-10de34d79d81 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042624 Jul 04 10:12:14.581816 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 214/431] 10.222.0.79 () {58 vars in 1301 bytes} [Mon Jul 4 10:12:14 2022] GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:12:14.711637 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-bf29a7cc-6b65-47e7-b9dd-a735dfcca451 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:14.712462 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-bf29a7cc-6b65-47e7-b9dd-a735dfcca451 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:14.724333 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bf29a7cc-6b65-47e7-b9dd-a735dfcca451 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:14.725067 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bf29a7cc-6b65-47e7-b9dd-a735dfcca451 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:14.726363 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bf29a7cc-6b65-47e7-b9dd-a735dfcca451 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:14.727094 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bf29a7cc-6b65-47e7-b9dd-a735dfcca451 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:14.865653 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-bf29a7cc-6b65-47e7-b9dd-a735dfcca451 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:14.873466 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-bf29a7cc-6b65-47e7-b9dd-a735dfcca451 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1258 microversion: 2.1 time: 0.168696 Jul 04 10:12:14.874068 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 218/432] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:14 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1258 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:15.601074 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-1e4f76d2-0104-4b17-bd57-3efbf4524886 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:15.602594 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-1e4f76d2-0104-4b17-bd57-3efbf4524886 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:15.610893 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1e4f76d2-0104-4b17-bd57-3efbf4524886 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:15.611348 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1e4f76d2-0104-4b17-bd57-3efbf4524886 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:15.612122 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1e4f76d2-0104-4b17-bd57-3efbf4524886 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:15.612555 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1e4f76d2-0104-4b17-bd57-3efbf4524886 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:15.644057 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-1e4f76d2-0104-4b17-bd57-3efbf4524886 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049525 Jul 04 10:12:15.644642 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 215/433] 10.222.0.79 () {58 vars in 1301 bytes} [Mon Jul 4 10:12:15 2022] GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:12:15.894791 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-1b02cd64-a851-482f-adc3-f529d35a52e0 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:15.895728 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-1b02cd64-a851-482f-adc3-f529d35a52e0 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:15.905645 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1b02cd64-a851-482f-adc3-f529d35a52e0 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:15.906110 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1b02cd64-a851-482f-adc3-f529d35a52e0 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:15.906879 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1b02cd64-a851-482f-adc3-f529d35a52e0 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:15.907311 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1b02cd64-a851-482f-adc3-f529d35a52e0 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:16.043361 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-1b02cd64-a851-482f-adc3-f529d35a52e0 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:16.051064 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-1b02cd64-a851-482f-adc3-f529d35a52e0 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1258 microversion: 2.1 time: 0.163123 Jul 04 10:12:16.051632 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 219/434] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:15 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:16.658763 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-a25d1423-41d1-407a-b15a-3e6dbd29c6d7 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:16.660453 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-a25d1423-41d1-407a-b15a-3e6dbd29c6d7 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:16.669258 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a25d1423-41d1-407a-b15a-3e6dbd29c6d7 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:16.669793 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a25d1423-41d1-407a-b15a-3e6dbd29c6d7 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:16.670564 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a25d1423-41d1-407a-b15a-3e6dbd29c6d7 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:16.670985 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a25d1423-41d1-407a-b15a-3e6dbd29c6d7 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:16.705937 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-a25d1423-41d1-407a-b15a-3e6dbd29c6d7 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052413 Jul 04 10:12:16.706917 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 216/435] 10.222.0.79 () {58 vars in 1301 bytes} [Mon Jul 4 10:12:16 2022] GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:12:17.072507 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-39728df6-4258-4644-ad30-d906c6a69454 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:17.073444 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-39728df6-4258-4644-ad30-d906c6a69454 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:17.084690 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-39728df6-4258-4644-ad30-d906c6a69454 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:17.085437 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-39728df6-4258-4644-ad30-d906c6a69454 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:17.086851 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-39728df6-4258-4644-ad30-d906c6a69454 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:17.087569 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-39728df6-4258-4644-ad30-d906c6a69454 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:17.233703 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-39728df6-4258-4644-ad30-d906c6a69454 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:17.241533 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-39728df6-4258-4644-ad30-d906c6a69454 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1442 microversion: 2.1 time: 0.175534 Jul 04 10:12:17.242157 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 220/436] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:17 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1442 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:17.259012 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-2da0a686-c2c2-4d0c-8f7a-f7f606bf99a0 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:17.259665 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-2da0a686-c2c2-4d0c-8f7a-f7f606bf99a0 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:17.266812 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2da0a686-c2c2-4d0c-8f7a-f7f606bf99a0 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:17.267261 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2da0a686-c2c2-4d0c-8f7a-f7f606bf99a0 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:17.268027 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2da0a686-c2c2-4d0c-8f7a-f7f606bf99a0 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:17.268458 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2da0a686-c2c2-4d0c-8f7a-f7f606bf99a0 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:17.407846 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-2da0a686-c2c2-4d0c-8f7a-f7f606bf99a0 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:17.416934 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-2da0a686-c2c2-4d0c-8f7a-f7f606bf99a0 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1442 microversion: 2.1 time: 0.161728 Jul 04 10:12:17.417710 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 217/437] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:17 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1442 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:12:17.701460 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-99a4782a-9427-42f2-bc04-37808d44fcb5 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:12:17.702481 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-99a4782a-9427-42f2-bc04-37808d44fcb5 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:17.708466 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-99a4782a-9427-42f2-bc04-37808d44fcb5 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:17.708890 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-99a4782a-9427-42f2-bc04-37808d44fcb5 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:17.709665 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-99a4782a-9427-42f2-bc04-37808d44fcb5 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:17.710274 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-99a4782a-9427-42f2-bc04-37808d44fcb5 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:17.719205 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-29f421c2-bba1-43e4-8fff-7abb3e4b10f9 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:17.720253 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-29f421c2-bba1-43e4-8fff-7abb3e4b10f9 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:17.726391 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-29f421c2-bba1-43e4-8fff-7abb3e4b10f9 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:17.726854 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-29f421c2-bba1-43e4-8fff-7abb3e4b10f9 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:17.727596 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-29f421c2-bba1-43e4-8fff-7abb3e4b10f9 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:17.728011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-29f421c2-bba1-43e4-8fff-7abb3e4b10f9 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:17.737897 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.objects.instance [None req-99a4782a-9427-42f2-bc04-37808d44fcb5 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lazy-loading 'flavor' on Instance uuid cae1c9c4-3ee8-4aae-8911-21df5f3c37df {{(pid=117865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 10:12:17.766596 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-29f421c2-bba1-43e4-8fff-7abb3e4b10f9 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052453 Jul 04 10:12:17.767515 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 218/438] 10.222.0.79 () {58 vars in 1301 bytes} [Mon Jul 4 10:12:17 2022] GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 10:12:17.879832 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-99a4782a-9427-42f2-bc04-37808d44fcb5 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "POST /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df/action" status: 200 len: 32 microversion: 2.1 time: 0.182291 Jul 04 10:12:17.880439 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 221/439] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Jul 4 10:12:17 2022] POST /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df/action => generated 32 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 10:12:17.889972 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-ad6896d9-f81b-4cde-afdb-396d2d0b7c6e tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:17.890586 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-ad6896d9-f81b-4cde-afdb-396d2d0b7c6e tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:17.898214 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ad6896d9-f81b-4cde-afdb-396d2d0b7c6e tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:17.898778 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ad6896d9-f81b-4cde-afdb-396d2d0b7c6e tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:17.899693 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ad6896d9-f81b-4cde-afdb-396d2d0b7c6e tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:17.900379 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ad6896d9-f81b-4cde-afdb-396d2d0b7c6e tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:18.217420 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-ad6896d9-f81b-4cde-afdb-396d2d0b7c6e tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:18.226021 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-ad6896d9-f81b-4cde-afdb-396d2d0b7c6e tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1736 microversion: 2.1 time: 0.340028 Jul 04 10:12:18.227093 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 219/440] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:17 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1736 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:12:18.780922 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-45327d21-dd5e-4fa0-b8ad-15807ded267f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:18.795223 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-45327d21-dd5e-4fa0-b8ad-15807ded267f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:18.802456 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-45327d21-dd5e-4fa0-b8ad-15807ded267f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:18.803211 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-45327d21-dd5e-4fa0-b8ad-15807ded267f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:18.803987 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-45327d21-dd5e-4fa0-b8ad-15807ded267f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:18.804412 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-45327d21-dd5e-4fa0-b8ad-15807ded267f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:18.839153 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-45327d21-dd5e-4fa0-b8ad-15807ded267f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063578 Jul 04 10:12:18.839153 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 222/441] 10.222.0.79 () {58 vars in 1301 bytes} [Mon Jul 4 10:12:18 2022] GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 10:12:18.900832 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-6da8b9eb-a2dd-414d-bff3-2b3dd22ab3fd tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:18.901460 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-6da8b9eb-a2dd-414d-bff3-2b3dd22ab3fd tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:18.908593 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-6da8b9eb-a2dd-414d-bff3-2b3dd22ab3fd tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:18.909130 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-6da8b9eb-a2dd-414d-bff3-2b3dd22ab3fd tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:18.910112 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-6da8b9eb-a2dd-414d-bff3-2b3dd22ab3fd tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:18.910538 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-6da8b9eb-a2dd-414d-bff3-2b3dd22ab3fd tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:18.938844 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-6da8b9eb-a2dd-414d-bff3-2b3dd22ab3fd tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Going to try to terminate instance {{(pid=117866) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 10:12:19.043579 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-6da8b9eb-a2dd-414d-bff3-2b3dd22ab3fd tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d" status: 204 len: 0 microversion: 2.1 time: 0.146094 Jul 04 10:12:19.044967 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 220/442] 10.222.0.79 () {58 vars in 1238 bytes} [Mon Jul 4 10:12:18 2022] DELETE /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 10:12:19.052881 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-99aa3164-a042-470a-b96f-7b5966ed778b tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:19.053860 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-99aa3164-a042-470a-b96f-7b5966ed778b tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:19.060791 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-99aa3164-a042-470a-b96f-7b5966ed778b tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:19.061252 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-99aa3164-a042-470a-b96f-7b5966ed778b tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:19.062059 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-99aa3164-a042-470a-b96f-7b5966ed778b tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:19.062500 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-99aa3164-a042-470a-b96f-7b5966ed778b tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:19.244422 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-424c7b82-92ec-40a6-bb54-1121c2c32cfa tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:19.245148 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-424c7b82-92ec-40a6-bb54-1121c2c32cfa tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:19.253476 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-424c7b82-92ec-40a6-bb54-1121c2c32cfa tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:19.253956 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-424c7b82-92ec-40a6-bb54-1121c2c32cfa tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:19.254856 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-424c7b82-92ec-40a6-bb54-1121c2c32cfa tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:19.255368 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-424c7b82-92ec-40a6-bb54-1121c2c32cfa tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:19.353147 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-99aa3164-a042-470a-b96f-7b5966ed778b tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:19.362175 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-99aa3164-a042-470a-b96f-7b5966ed778b tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d" status: 200 len: 1681 microversion: 2.1 time: 0.312890 Jul 04 10:12:19.362883 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 223/443] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:19 2022] GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d => generated 1681 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:19.509708 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-424c7b82-92ec-40a6-bb54-1121c2c32cfa tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:19.518890 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-424c7b82-92ec-40a6-bb54-1121c2c32cfa tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1736 microversion: 2.1 time: 0.278641 Jul 04 10:12:19.519464 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 221/444] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:19 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1736 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:20.143912 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-7fe24969-068a-4e31-8d01-a899d45236fc req-b1d8d780-504a-4aeb-9021-4a6fe9f83d28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9526d9a-e0e4-4708-a2da-872d57732128", "tag": "0561989e-f05a-46b1-a7cf-00085ff7229a"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:12:20.152879 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-7fe24969-068a-4e31-8d01-a899d45236fc req-b1d8d780-504a-4aeb-9021-4a6fe9f83d28 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:20.153333 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-7fe24969-068a-4e31-8d01-a899d45236fc req-b1d8d780-504a-4aeb-9021-4a6fe9f83d28 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:20.165412 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-7fe24969-068a-4e31-8d01-a899d45236fc req-b1d8d780-504a-4aeb-9021-4a6fe9f83d28 service nova] Creating event network-changed:0561989e-f05a-46b1-a7cf-00085ff7229a for instance f9526d9a-e0e4-4708-a2da-872d57732128 on hv-cinder-84841 Jul 04 10:12:20.170560 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-7fe24969-068a-4e31-8d01-a899d45236fc req-b1d8d780-504a-4aeb-9021-4a6fe9f83d28 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030673 Jul 04 10:12:20.171165 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 224/445] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:12:20.394905 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-a5e5364a-7a1a-4e67-8303-1206396d7fdf tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:20.396110 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-a5e5364a-7a1a-4e67-8303-1206396d7fdf tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:20.408392 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a5e5364a-7a1a-4e67-8303-1206396d7fdf tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:20.408721 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a5e5364a-7a1a-4e67-8303-1206396d7fdf tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:20.409482 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a5e5364a-7a1a-4e67-8303-1206396d7fdf tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:20.416060 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a5e5364a-7a1a-4e67-8303-1206396d7fdf tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:20.539269 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-17545f5d-7b92-417b-9a2e-58b9bcce3844 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:20.539959 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-17545f5d-7b92-417b-9a2e-58b9bcce3844 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:20.547416 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-17545f5d-7b92-417b-9a2e-58b9bcce3844 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:20.547826 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-17545f5d-7b92-417b-9a2e-58b9bcce3844 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:20.548794 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-17545f5d-7b92-417b-9a2e-58b9bcce3844 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:20.549440 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-17545f5d-7b92-417b-9a2e-58b9bcce3844 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:20.677225 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-a5e5364a-7a1a-4e67-8303-1206396d7fdf tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:20.686494 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-a5e5364a-7a1a-4e67-8303-1206396d7fdf tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d" status: 200 len: 1681 microversion: 2.1 time: 0.306966 Jul 04 10:12:20.687244 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 222/446] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:20 2022] GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d => generated 1681 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:20.814858 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-17545f5d-7b92-417b-9a2e-58b9bcce3844 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:20.825176 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-17545f5d-7b92-417b-9a2e-58b9bcce3844 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1736 microversion: 2.1 time: 0.289954 Jul 04 10:12:20.826265 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 225/447] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:20 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1736 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:12:21.705427 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-28e70d94-3935-4d61-9f35-d475f9c1a72c tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:21.706068 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-28e70d94-3935-4d61-9f35-d475f9c1a72c tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:21.712630 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-28e70d94-3935-4d61-9f35-d475f9c1a72c tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:21.713056 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-28e70d94-3935-4d61-9f35-d475f9c1a72c tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:21.713874 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-28e70d94-3935-4d61-9f35-d475f9c1a72c tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:21.714305 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-28e70d94-3935-4d61-9f35-d475f9c1a72c tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:21.783810 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-28e70d94-3935-4d61-9f35-d475f9c1a72c tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:21.795351 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-28e70d94-3935-4d61-9f35-d475f9c1a72c tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d" status: 200 len: 1613 microversion: 2.1 time: 0.094250 Jul 04 10:12:21.796166 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 223/448] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:21 2022] GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d => generated 1613 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:21.843515 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b4711d47-8451-41da-8e0d-1c3c78b8121b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:21.844117 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-b4711d47-8451-41da-8e0d-1c3c78b8121b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:21.850945 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b4711d47-8451-41da-8e0d-1c3c78b8121b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:21.851524 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b4711d47-8451-41da-8e0d-1c3c78b8121b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:21.852299 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b4711d47-8451-41da-8e0d-1c3c78b8121b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:21.852731 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b4711d47-8451-41da-8e0d-1c3c78b8121b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:22.015267 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-b4711d47-8451-41da-8e0d-1c3c78b8121b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:22.024728 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-b4711d47-8451-41da-8e0d-1c3c78b8121b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1736 microversion: 2.1 time: 0.185597 Jul 04 10:12:22.025337 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 226/449] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:21 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1736 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:22.185265 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-9bf155f4-f5df-4a3c-8296-78ea0afc3f46 req-0ff22569-b0dc-4f6e-8ad4-ff8b18919885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9659bd27-cdfe-44b1-9ffe-bec5319c9b5d", "name": "network-vif-deleted", "tag": "5a1d4ccd-d32e-4fbf-9325-25b20937bbb8"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:12:22.193932 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-9bf155f4-f5df-4a3c-8296-78ea0afc3f46 req-0ff22569-b0dc-4f6e-8ad4-ff8b18919885 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:22.194386 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-9bf155f4-f5df-4a3c-8296-78ea0afc3f46 req-0ff22569-b0dc-4f6e-8ad4-ff8b18919885 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:22.205512 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-9bf155f4-f5df-4a3c-8296-78ea0afc3f46 req-0ff22569-b0dc-4f6e-8ad4-ff8b18919885 service nova] Creating event network-vif-deleted:5a1d4ccd-d32e-4fbf-9325-25b20937bbb8 for instance 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d on hv-cinder-84841 Jul 04 10:12:22.210342 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-9bf155f4-f5df-4a3c-8296-78ea0afc3f46 req-0ff22569-b0dc-4f6e-8ad4-ff8b18919885 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029033 Jul 04 10:12:22.210923 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 224/450] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:12:22.813415 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-75266f7b-9510-419a-8d28-15ada18196f0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:22.813952 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-75266f7b-9510-419a-8d28-15ada18196f0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:22.820452 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-75266f7b-9510-419a-8d28-15ada18196f0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:22.820903 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-75266f7b-9510-419a-8d28-15ada18196f0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:22.821677 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-75266f7b-9510-419a-8d28-15ada18196f0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:22.822132 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-75266f7b-9510-419a-8d28-15ada18196f0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:22.836345 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-75266f7b-9510-419a-8d28-15ada18196f0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] HTTP exception thrown: Instance 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d could not be found. Jul 04 10:12:22.837999 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-75266f7b-9510-419a-8d28-15ada18196f0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Request method failure captured: Jul 04 10:12:22.837999 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: request: GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d HTTP/1.1 Jul 04 10:12:22.837999 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept: application/json Jul 04 10:12:22.837999 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept-Encoding: identity Jul 04 10:12:22.837999 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Connection: close Jul 04 10:12:22.837999 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Length: 0 Jul 04 10:12:22.837999 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Type: application/json Jul 04 10:12:22.837999 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Host: 10.222.0.79 Jul 04 10:12:22.837999 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 04 10:12:22.837999 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 04 10:12:22.837999 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Auth-Token: gAAAAABiwrwvD9yiGE4pStEGBF2Ys-pryu1tx1k2auUnE0PRvpPvnRtEQEaHpqZQ8egutal5ICM4nB9U9UkZUlVAaFmujyok7-zJ_4u8OoD2UCOlqV-Oyun1vIdrrzMPcAwbXsLkKDns-0TZYcaWBDNIYObNG0qh5NpdFBBI5iioapUAgXk4vDM Jul 04 10:12:22.837999 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Id: None Jul 04 10:12:22.837999 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Name: None Jul 04 10:12:22.837999 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 04 10:12:22.837999 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 04 10:12:22.837999 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 04 10:12:22.837999 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 04 10:12:22.837999 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Id: a57f93d66f534107a228d908afa64890 Jul 04 10:12:22.837999 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Name: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:12:22.837999 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Role: reader,member Jul 04 10:12:22.837999 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Roles: reader,member Jul 04 10:12:22.839441 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a57f93d66f534107a228d908afa64890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a57f93d66f534107a228d908afa64890"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a57f93d66f534107a228d908afa64890"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a57f93d66f534107a228d908afa64890"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:12:22.839441 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:12:22.839441 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Id: a57f93d66f534107a228d908afa64890 Jul 04 10:12:22.839441 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:12:22.839441 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User: tempest-AttachVolumeNegativeTest-223944498-project Jul 04 10:12:22.839441 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 04 10:12:22.839441 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 04 10:12:22.839441 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Id: 88d2351fc3b74ef5a530fded1be6b997 Jul 04 10:12:22.839441 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Name: tempest-AttachVolumeNegativeTest-223944498-project Jul 04 10:12:22.839441 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: method: > Jul 04 10:12:22.839441 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: exception: Instance 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d could not be found. Jul 04 10:12:22.839441 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: action_args: {'id': '9659bd27-cdfe-44b1-9ffe-bec5319c9b5d'} Jul 04 10:12:22.840332 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:12:22.840332 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:12:22.840332 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:12:22.840332 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:12:22.840332 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:12:22.840332 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:12:22.840332 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:12:22.840332 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:12:22.840332 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:12:22.840332 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:12:22.840332 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d could not be found. Jul 04 10:12:22.840332 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:12:22.840332 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:12:22.840332 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:12:22.840332 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:12:22.840332 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:12:22.840332 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:12:22.840332 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:12:22.840332 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:12:22.840332 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:12:22.842434 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:12:22.842434 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 10:12:22.842434 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 10:12:22.842434 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:12:22.842434 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:12:22.842434 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:12:22.842434 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:12:22.842434 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d could not be found. Jul 04 10:12:22.842434 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:12:22.842434 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:12:22.842434 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:12:22.842434 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:12:22.842434 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:12:22.842434 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:12:22.842434 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:12:22.842434 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:12:22.842434 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d could not be found. Jul 04 10:12:22.842434 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:12:22.843476 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-75266f7b-9510-419a-8d28-15ada18196f0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Returning 404 to user: Instance 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:12:22.843476 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-75266f7b-9510-419a-8d28-15ada18196f0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d" status: 404 len: 111 microversion: 2.1 time: 0.030452 Jul 04 10:12:22.843476 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 227/451] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:22 2022] GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:12:22.849699 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-4b98dfcd-3ad4-42fa-8372-33fcec1a63bf tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '.version_select at 0x7f28080eb790>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:22.870451 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-4b98dfcd-3ad4-42fa-8372-33fcec1a63bf tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1525440355" status: 202 len: 0 microversion: 2.1 time: 0.024885 Jul 04 10:12:22.871286 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 225/452] 10.222.0.79 () {58 vars in 1220 bytes} [Mon Jul 4 10:12:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1525440355 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 10:12:23.042451 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5e6b2961-91f8-4a0d-a797-3a759e73c454 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:23.043254 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-5e6b2961-91f8-4a0d-a797-3a759e73c454 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:23.050602 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5e6b2961-91f8-4a0d-a797-3a759e73c454 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:23.051046 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5e6b2961-91f8-4a0d-a797-3a759e73c454 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:23.051831 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5e6b2961-91f8-4a0d-a797-3a759e73c454 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:23.052262 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5e6b2961-91f8-4a0d-a797-3a759e73c454 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:23.327205 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-5e6b2961-91f8-4a0d-a797-3a759e73c454 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:23.337190 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-5e6b2961-91f8-4a0d-a797-3a759e73c454 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1736 microversion: 2.1 time: 0.298500 Jul 04 10:12:23.337935 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 228/453] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:23 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1736 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:23.779651 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-138a40f6-3a60-4507-a2e6-a102c93e6ad4 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Action: 'create', calling method: .version_select at 0x7f2808195280>, body: {"keypair": {"name": "tempest-keypair-904486765", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9JNFL7Y1IsEbt+mRkbC0b0AjuB0qOMaNHlnoExE6dMrhshZj9pxZTBpc5djNsskcaS8EtqeyynamzN3iyku4RcjVMGLNqwG0jr3M7TnqST1a+tsAyU7tnuNgSp7FXRxg=="}} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:12:23.795823 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.quota [None req-138a40f6-3a60-4507-a2e6-a102c93e6ad4 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Getting quotas for project a57f93d66f534107a228d908afa64890. Resources: {'key_pairs'} {{(pid=117866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 10:12:23.800983 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.quota [None req-138a40f6-3a60-4507-a2e6-a102c93e6ad4 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Getting quotas for user 88d2351fc3b74ef5a530fded1be6b997 and project a57f93d66f534107a228d908afa64890. Resources: {'key_pairs'} {{(pid=117866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 10:12:23.828927 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-138a40f6-3a60-4507-a2e6-a102c93e6ad4 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053570 Jul 04 10:12:23.829559 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 226/454] 10.222.0.79 () {60 vars in 1158 bytes} [Mon Jul 4 10:12:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:12:24.358717 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-33b18907-e1c6-4c9b-a23a-5905dbe9f1d4 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:24.359552 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-33b18907-e1c6-4c9b-a23a-5905dbe9f1d4 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:24.369375 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-33b18907-e1c6-4c9b-a23a-5905dbe9f1d4 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:24.369947 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-33b18907-e1c6-4c9b-a23a-5905dbe9f1d4 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:24.371186 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-33b18907-e1c6-4c9b-a23a-5905dbe9f1d4 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:24.371840 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-33b18907-e1c6-4c9b-a23a-5905dbe9f1d4 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:24.566036 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-33b18907-e1c6-4c9b-a23a-5905dbe9f1d4 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:24.574091 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-33b18907-e1c6-4c9b-a23a-5905dbe9f1d4 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1736 microversion: 2.1 time: 0.222099 Jul 04 10:12:24.574646 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 229/455] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:24 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:25.254648 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-3239fc41-5fb2-4fb2-8001-9554b599b03f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-242993678", "imageRef": "80bd29b0-b77c-4611-be31-69ca559a2d2a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3ebecf3d-37d9-4ade-a898-e313cec92aef"}], "security_groups": [{"name": "tempest-securitygroup--161517322"}], "key_name": "tempest-keypair-904486765", "user_data": "}} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:12:25.359304 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.network.neutron [None req-3239fc41-5fb2-4fb2-8001-9554b599b03f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] validate_networks() for [('3ebecf3d-37d9-4ade-a898-e313cec92aef', None, None, None, None, None)] {{(pid=117866) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 10:12:25.593199 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-858f5b49-87e3-48a0-a173-08d450228894 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:25.593870 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-858f5b49-87e3-48a0-a173-08d450228894 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:25.600611 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-858f5b49-87e3-48a0-a173-08d450228894 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:25.601052 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-858f5b49-87e3-48a0-a173-08d450228894 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:25.601922 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-858f5b49-87e3-48a0-a173-08d450228894 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:25.602348 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-858f5b49-87e3-48a0-a173-08d450228894 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:25.800710 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-3239fc41-5fb2-4fb2-8001-9554b599b03f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Flavor limits 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 10:12:25.802070 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-3239fc41-5fb2-4fb2-8001-9554b599b03f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Image limits 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 10:12:25.802657 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-3239fc41-5fb2-4fb2-8001-9554b599b03f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Flavor pref 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 10:12:25.803095 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-3239fc41-5fb2-4fb2-8001-9554b599b03f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Image pref 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 10:12:25.803500 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-3239fc41-5fb2-4fb2-8001-9554b599b03f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 10:12:25.803884 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-858f5b49-87e3-48a0-a173-08d450228894 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:25.806238 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:12:25.813174 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3239fc41-5fb2-4fb2-8001-9554b599b03f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:25.813826 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3239fc41-5fb2-4fb2-8001-9554b599b03f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:25.814407 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-858f5b49-87e3-48a0-a173-08d450228894 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1736 microversion: 2.1 time: 0.225874 Jul 04 10:12:25.814751 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3239fc41-5fb2-4fb2-8001-9554b599b03f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:25.814985 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 230/456] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:25 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:25.815314 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3239fc41-5fb2-4fb2-8001-9554b599b03f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:25.832347 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.quota [None req-3239fc41-5fb2-4fb2-8001-9554b599b03f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Getting quotas for project a57f93d66f534107a228d908afa64890. Resources: {'cores', 'ram', 'instances'} {{(pid=117866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 10:12:25.836435 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.quota [None req-3239fc41-5fb2-4fb2-8001-9554b599b03f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Getting quotas for user 88d2351fc3b74ef5a530fded1be6b997 and project a57f93d66f534107a228d908afa64890. Resources: {'cores', 'ram', 'instances'} {{(pid=117866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 10:12:25.848096 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-3239fc41-5fb2-4fb2-8001-9554b599b03f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Going to run 1 instances... {{(pid=117866) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 10:12:25.850462 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-3239fc41-5fb2-4fb2-8001-9554b599b03f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a936822b-ef8c-42ad-9510-194756830a00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80bd29b0-b77c-4611-be31-69ca559a2d2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 10:12:25.909538 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-3239fc41-5fb2-4fb2-8001-9554b599b03f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.659069 Jul 04 10:12:25.910376 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 227/457] 10.222.0.79 () {60 vars in 1146 bytes} [Mon Jul 4 10:12:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 04 10:12:25.920656 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-80c9bc80-22bd-4667-a584-a180b4f7c83f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:25.921251 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-80c9bc80-22bd-4667-a584-a180b4f7c83f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a936822b-ef8c-42ad-9510-194756830a00] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:25.980375 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-80c9bc80-22bd-4667-a584-a180b4f7c83f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:25.987618 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-80c9bc80-22bd-4667-a584-a180b4f7c83f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00" status: 200 len: 1240 microversion: 2.1 time: 0.071057 Jul 04 10:12:25.988204 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 231/458] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:25 2022] GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00 => generated 1240 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:26.835806 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-8410846d-b90f-4599-9266-3788cd1c47d3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:26.836757 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-8410846d-b90f-4599-9266-3788cd1c47d3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:26.846665 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8410846d-b90f-4599-9266-3788cd1c47d3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:26.847110 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8410846d-b90f-4599-9266-3788cd1c47d3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:26.847874 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8410846d-b90f-4599-9266-3788cd1c47d3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:26.848297 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8410846d-b90f-4599-9266-3788cd1c47d3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:26.982345 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-8410846d-b90f-4599-9266-3788cd1c47d3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:26.992604 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-8410846d-b90f-4599-9266-3788cd1c47d3 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1736 microversion: 2.1 time: 0.163212 Jul 04 10:12:26.993186 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 228/459] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:26 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:27.004471 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-853825d6-c6f5-4219-b2cf-fc2e57b1c8a0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:27.005258 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-853825d6-c6f5-4219-b2cf-fc2e57b1c8a0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a936822b-ef8c-42ad-9510-194756830a00] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:27.012359 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-853825d6-c6f5-4219-b2cf-fc2e57b1c8a0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:27.012813 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-853825d6-c6f5-4219-b2cf-fc2e57b1c8a0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:27.013659 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-853825d6-c6f5-4219-b2cf-fc2e57b1c8a0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:27.014157 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-853825d6-c6f5-4219-b2cf-fc2e57b1c8a0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:27.092417 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-853825d6-c6f5-4219-b2cf-fc2e57b1c8a0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:27.100922 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-853825d6-c6f5-4219-b2cf-fc2e57b1c8a0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00" status: 200 len: 1300 microversion: 2.1 time: 0.100339 Jul 04 10:12:27.101604 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 232/460] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:26 2022] GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00 => generated 1300 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:28.010834 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-d1f77c79-10a9-449e-8672-d821232f37b5 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:28.011529 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-d1f77c79-10a9-449e-8672-d821232f37b5 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:28.018157 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d1f77c79-10a9-449e-8672-d821232f37b5 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:28.018609 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d1f77c79-10a9-449e-8672-d821232f37b5 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:28.019382 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d1f77c79-10a9-449e-8672-d821232f37b5 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:28.019816 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d1f77c79-10a9-449e-8672-d821232f37b5 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:28.118566 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-466a2e17-7df8-4590-818e-c623c73704e5 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:28.119501 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-466a2e17-7df8-4590-818e-c623c73704e5 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a936822b-ef8c-42ad-9510-194756830a00] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:28.126652 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-466a2e17-7df8-4590-818e-c623c73704e5 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:28.127183 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-466a2e17-7df8-4590-818e-c623c73704e5 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:28.128729 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-466a2e17-7df8-4590-818e-c623c73704e5 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:28.129229 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-466a2e17-7df8-4590-818e-c623c73704e5 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:28.266428 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-d1f77c79-10a9-449e-8672-d821232f37b5 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:28.275172 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-d1f77c79-10a9-449e-8672-d821232f37b5 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1736 microversion: 2.1 time: 0.268751 Jul 04 10:12:28.275932 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 229/461] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:28 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1736 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:28.360285 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-466a2e17-7df8-4590-818e-c623c73704e5 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:28.368482 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-466a2e17-7df8-4590-818e-c623c73704e5 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00" status: 200 len: 1365 microversion: 2.1 time: 0.253774 Jul 04 10:12:28.369572 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 233/462] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:28 2022] GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00 => generated 1365 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:28.603874 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-1736d7f8-3d46-4e1d-aa98-5af511766962 req-8264f635-585a-45dc-9c92-ca353977867c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a936822b-ef8c-42ad-9510-194756830a00", "tag": "111fd0b9-55ad-4e25-93cf-69456c116c74"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:12:28.614336 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-1736d7f8-3d46-4e1d-aa98-5af511766962 req-8264f635-585a-45dc-9c92-ca353977867c service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:28.614742 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-1736d7f8-3d46-4e1d-aa98-5af511766962 req-8264f635-585a-45dc-9c92-ca353977867c service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:28.632218 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-1736d7f8-3d46-4e1d-aa98-5af511766962 req-8264f635-585a-45dc-9c92-ca353977867c service nova] Creating event network-changed:111fd0b9-55ad-4e25-93cf-69456c116c74 for instance a936822b-ef8c-42ad-9510-194756830a00 on hv-cinder-84841 Jul 04 10:12:28.637767 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-1736d7f8-3d46-4e1d-aa98-5af511766962 req-8264f635-585a-45dc-9c92-ca353977867c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037814 Jul 04 10:12:28.638702 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 230/463] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:12:29.292878 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-6d42c296-14fe-4b9c-93e1-5e337cdd0dd9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:29.293500 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-6d42c296-14fe-4b9c-93e1-5e337cdd0dd9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:29.300942 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6d42c296-14fe-4b9c-93e1-5e337cdd0dd9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:29.301340 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6d42c296-14fe-4b9c-93e1-5e337cdd0dd9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:29.302141 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6d42c296-14fe-4b9c-93e1-5e337cdd0dd9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:29.302568 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6d42c296-14fe-4b9c-93e1-5e337cdd0dd9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:29.386967 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-8d39cd71-b304-431a-9525-cd9be8834b81 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:29.387654 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-8d39cd71-b304-431a-9525-cd9be8834b81 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a936822b-ef8c-42ad-9510-194756830a00] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:29.393907 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8d39cd71-b304-431a-9525-cd9be8834b81 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:29.394339 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8d39cd71-b304-431a-9525-cd9be8834b81 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:29.395073 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8d39cd71-b304-431a-9525-cd9be8834b81 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:29.395496 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8d39cd71-b304-431a-9525-cd9be8834b81 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:29.451569 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-6d42c296-14fe-4b9c-93e1-5e337cdd0dd9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:29.460763 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-6d42c296-14fe-4b9c-93e1-5e337cdd0dd9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1736 microversion: 2.1 time: 0.171757 Jul 04 10:12:29.461384 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 234/464] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:29 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:29.538269 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-8d39cd71-b304-431a-9525-cd9be8834b81 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:29.546127 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-8d39cd71-b304-431a-9525-cd9be8834b81 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00" status: 200 len: 1365 microversion: 2.1 time: 0.163559 Jul 04 10:12:29.546676 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 231/465] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:29 2022] GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:30.480596 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5f9d190c-9520-4983-a85f-b6f64e4bf042 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:30.481262 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-5f9d190c-9520-4983-a85f-b6f64e4bf042 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:30.487895 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5f9d190c-9520-4983-a85f-b6f64e4bf042 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:30.488344 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5f9d190c-9520-4983-a85f-b6f64e4bf042 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:30.489131 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5f9d190c-9520-4983-a85f-b6f64e4bf042 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:30.489561 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5f9d190c-9520-4983-a85f-b6f64e4bf042 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:30.564819 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-1045e868-a19d-425d-a52b-dd1b85a41f25 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:30.565466 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-1045e868-a19d-425d-a52b-dd1b85a41f25 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a936822b-ef8c-42ad-9510-194756830a00] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:30.571522 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1045e868-a19d-425d-a52b-dd1b85a41f25 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:30.571956 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1045e868-a19d-425d-a52b-dd1b85a41f25 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:30.572742 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1045e868-a19d-425d-a52b-dd1b85a41f25 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:30.573131 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1045e868-a19d-425d-a52b-dd1b85a41f25 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:30.690285 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-5f9d190c-9520-4983-a85f-b6f64e4bf042 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:30.698902 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-5f9d190c-9520-4983-a85f-b6f64e4bf042 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1736 microversion: 2.1 time: 0.222151 Jul 04 10:12:30.699481 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 235/466] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:30 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:30.735428 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-1045e868-a19d-425d-a52b-dd1b85a41f25 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:30.737774 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:12:30.744428 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-1045e868-a19d-425d-a52b-dd1b85a41f25 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00" status: 200 len: 1365 microversion: 2.1 time: 0.184984 Jul 04 10:12:30.744977 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 232/467] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:30 2022] GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00 => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:31.720721 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-1b656fcd-64a0-474d-bddc-981fddf1ba8a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:31.721445 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-1b656fcd-64a0-474d-bddc-981fddf1ba8a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:31.729898 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1b656fcd-64a0-474d-bddc-981fddf1ba8a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:31.730461 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1b656fcd-64a0-474d-bddc-981fddf1ba8a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:31.731407 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1b656fcd-64a0-474d-bddc-981fddf1ba8a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:31.731944 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1b656fcd-64a0-474d-bddc-981fddf1ba8a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:31.762339 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-6a6a312a-838d-4b87-acb7-16587cff91cd tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:31.762738 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-6a6a312a-838d-4b87-acb7-16587cff91cd tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a936822b-ef8c-42ad-9510-194756830a00] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:31.764891 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:12:31.773445 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-6a6a312a-838d-4b87-acb7-16587cff91cd tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:31.773913 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-6a6a312a-838d-4b87-acb7-16587cff91cd tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:31.774681 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-6a6a312a-838d-4b87-acb7-16587cff91cd tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:31.775107 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-6a6a312a-838d-4b87-acb7-16587cff91cd tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:31.916429 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-1b656fcd-64a0-474d-bddc-981fddf1ba8a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:31.924897 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-1b656fcd-64a0-474d-bddc-981fddf1ba8a tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1736 microversion: 2.1 time: 0.210891 Jul 04 10:12:31.925786 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 236/468] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:31 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1736 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:31.943478 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-6a6a312a-838d-4b87-acb7-16587cff91cd tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:31.951283 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-6a6a312a-838d-4b87-acb7-16587cff91cd tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00" status: 200 len: 1365 microversion: 2.1 time: 0.193294 Jul 04 10:12:31.951885 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 233/469] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:31 2022] GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00 => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:32.946483 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-c7989759-b052-4aa2-a006-acebf8aaf2d9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:32.947338 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-c7989759-b052-4aa2-a006-acebf8aaf2d9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:32.957162 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c7989759-b052-4aa2-a006-acebf8aaf2d9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:32.957610 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c7989759-b052-4aa2-a006-acebf8aaf2d9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:32.958405 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c7989759-b052-4aa2-a006-acebf8aaf2d9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:32.958814 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c7989759-b052-4aa2-a006-acebf8aaf2d9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:32.968659 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-ddf26340-00b7-4a9c-a53e-cd4f7b72150d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:32.969264 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-ddf26340-00b7-4a9c-a53e-cd4f7b72150d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a936822b-ef8c-42ad-9510-194756830a00] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:32.975750 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ddf26340-00b7-4a9c-a53e-cd4f7b72150d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:32.976188 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ddf26340-00b7-4a9c-a53e-cd4f7b72150d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:32.976928 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ddf26340-00b7-4a9c-a53e-cd4f7b72150d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:32.977353 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ddf26340-00b7-4a9c-a53e-cd4f7b72150d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:33.152595 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-c7989759-b052-4aa2-a006-acebf8aaf2d9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:33.155826 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-ddf26340-00b7-4a9c-a53e-cd4f7b72150d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:33.161102 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-c7989759-b052-4aa2-a006-acebf8aaf2d9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1736 microversion: 2.1 time: 0.221338 Jul 04 10:12:33.161740 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 237/470] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:32 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:33.164202 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-ddf26340-00b7-4a9c-a53e-cd4f7b72150d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00" status: 200 len: 1365 microversion: 2.1 time: 0.199643 Jul 04 10:12:33.164773 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 234/471] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:32 2022] GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00 => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:34.179561 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-c7daebf4-8c95-4797-80ca-424bc835c547 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:34.180297 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-0110cba8-dac1-41fa-aaab-0587b063b26f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:34.180676 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-c7daebf4-8c95-4797-80ca-424bc835c547 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:34.181019 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-0110cba8-dac1-41fa-aaab-0587b063b26f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a936822b-ef8c-42ad-9510-194756830a00] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:34.183282 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:12:34.187825 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0110cba8-dac1-41fa-aaab-0587b063b26f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:34.188341 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0110cba8-dac1-41fa-aaab-0587b063b26f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:34.188455 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c7daebf4-8c95-4797-80ca-424bc835c547 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:34.188955 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c7daebf4-8c95-4797-80ca-424bc835c547 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:34.189521 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0110cba8-dac1-41fa-aaab-0587b063b26f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:34.189859 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c7daebf4-8c95-4797-80ca-424bc835c547 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:34.190101 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0110cba8-dac1-41fa-aaab-0587b063b26f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:34.190269 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c7daebf4-8c95-4797-80ca-424bc835c547 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:34.382836 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-0110cba8-dac1-41fa-aaab-0587b063b26f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:34.391782 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-0110cba8-dac1-41fa-aaab-0587b063b26f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00" status: 200 len: 1365 microversion: 2.1 time: 0.215432 Jul 04 10:12:34.392640 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 235/472] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:34 2022] GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00 => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:12:34.393122 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-c7daebf4-8c95-4797-80ca-424bc835c547 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:34.397578 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-12a56268-b6dc-4236-83e1-1fd43f1534a8 req-331ddb5d-d23c-43b3-abbd-2cfe9b62495a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a936822b-ef8c-42ad-9510-194756830a00", "name": "network-vif-plugged", "status": "completed", "tag": "111fd0b9-55ad-4e25-93cf-69456c116c74"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:12:34.401537 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-c7daebf4-8c95-4797-80ca-424bc835c547 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1736 microversion: 2.1 time: 0.226279 Jul 04 10:12:34.402126 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 238/473] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:34 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1736 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:34.406160 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-12a56268-b6dc-4236-83e1-1fd43f1534a8 req-331ddb5d-d23c-43b3-abbd-2cfe9b62495a service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:34.406576 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-12a56268-b6dc-4236-83e1-1fd43f1534a8 req-331ddb5d-d23c-43b3-abbd-2cfe9b62495a service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:34.418830 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-12a56268-b6dc-4236-83e1-1fd43f1534a8 req-331ddb5d-d23c-43b3-abbd-2cfe9b62495a service nova] Creating event network-vif-plugged:111fd0b9-55ad-4e25-93cf-69456c116c74 for instance a936822b-ef8c-42ad-9510-194756830a00 on hv-cinder-84841 Jul 04 10:12:34.424142 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-12a56268-b6dc-4236-83e1-1fd43f1534a8 req-331ddb5d-d23c-43b3-abbd-2cfe9b62495a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029818 Jul 04 10:12:34.424763 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 236/474] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:12:35.408826 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-ee36180d-7655-456e-9ca7-a283f506583d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:35.409427 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-ee36180d-7655-456e-9ca7-a283f506583d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a936822b-ef8c-42ad-9510-194756830a00] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:35.416605 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ee36180d-7655-456e-9ca7-a283f506583d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:35.417039 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ee36180d-7655-456e-9ca7-a283f506583d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:35.417845 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ee36180d-7655-456e-9ca7-a283f506583d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:35.418275 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ee36180d-7655-456e-9ca7-a283f506583d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:35.419458 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-b8e8e55b-3c43-4cfe-b29a-ea7c65004218 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:35.420165 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-b8e8e55b-3c43-4cfe-b29a-ea7c65004218 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:35.427087 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b8e8e55b-3c43-4cfe-b29a-ea7c65004218 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:35.427545 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b8e8e55b-3c43-4cfe-b29a-ea7c65004218 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:35.428327 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b8e8e55b-3c43-4cfe-b29a-ea7c65004218 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:35.428754 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b8e8e55b-3c43-4cfe-b29a-ea7c65004218 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:35.617469 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-ee36180d-7655-456e-9ca7-a283f506583d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:35.623881 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-b8e8e55b-3c43-4cfe-b29a-ea7c65004218 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:35.627906 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-ee36180d-7655-456e-9ca7-a283f506583d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00" status: 200 len: 1365 microversion: 2.1 time: 0.223164 Jul 04 10:12:35.628458 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 239/475] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:35 2022] GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00 => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:35.632571 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-b8e8e55b-3c43-4cfe-b29a-ea7c65004218 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1736 microversion: 2.1 time: 0.217350 Jul 04 10:12:35.637736 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 237/476] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:35 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:36.649228 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-c2c8660a-e8fa-4dad-9204-624d3dbb97e4 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:36.650253 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-c2c8660a-e8fa-4dad-9204-624d3dbb97e4 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a936822b-ef8c-42ad-9510-194756830a00] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:36.653118 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:12:36.653392 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-7c915bde-841c-4bcb-9864-b8a808bcd16d tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:36.654423 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-7c915bde-841c-4bcb-9864-b8a808bcd16d tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:36.657997 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell0:SELECT=2 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:12:36.659077 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell0:SELECT=10 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:12:36.662615 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c2c8660a-e8fa-4dad-9204-624d3dbb97e4 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:36.663347 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c2c8660a-e8fa-4dad-9204-624d3dbb97e4 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:36.664594 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c2c8660a-e8fa-4dad-9204-624d3dbb97e4 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:36.665295 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c2c8660a-e8fa-4dad-9204-624d3dbb97e4 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:36.669859 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7c915bde-841c-4bcb-9864-b8a808bcd16d tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:36.670587 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7c915bde-841c-4bcb-9864-b8a808bcd16d tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:36.671835 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7c915bde-841c-4bcb-9864-b8a808bcd16d tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:36.672554 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7c915bde-841c-4bcb-9864-b8a808bcd16d tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:36.871197 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-c2c8660a-e8fa-4dad-9204-624d3dbb97e4 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:36.874663 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-7c915bde-841c-4bcb-9864-b8a808bcd16d tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:36.879812 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-c2c8660a-e8fa-4dad-9204-624d3dbb97e4 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00" status: 200 len: 1365 microversion: 2.1 time: 0.237020 Jul 04 10:12:36.880401 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 240/477] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:36 2022] GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00 => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:36.884915 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-7c915bde-841c-4bcb-9864-b8a808bcd16d tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1736 microversion: 2.1 time: 0.237860 Jul 04 10:12:36.885743 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 238/478] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:36 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1736 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:37.899685 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-531f41ec-9ea1-4628-83ac-ca4c295448bb tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:37.900504 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-531f41ec-9ea1-4628-83ac-ca4c295448bb tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a936822b-ef8c-42ad-9510-194756830a00] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:37.904467 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-8f2e38c3-5f92-47ce-9917-46c4437d26fe tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:37.905314 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-8f2e38c3-5f92-47ce-9917-46c4437d26fe tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:37.909896 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-531f41ec-9ea1-4628-83ac-ca4c295448bb tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:37.910341 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-531f41ec-9ea1-4628-83ac-ca4c295448bb tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:37.911108 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-531f41ec-9ea1-4628-83ac-ca4c295448bb tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:37.911537 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-531f41ec-9ea1-4628-83ac-ca4c295448bb tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:37.912559 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8f2e38c3-5f92-47ce-9917-46c4437d26fe tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:37.913002 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8f2e38c3-5f92-47ce-9917-46c4437d26fe tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:37.913786 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8f2e38c3-5f92-47ce-9917-46c4437d26fe tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:37.914212 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8f2e38c3-5f92-47ce-9917-46c4437d26fe tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:38.111547 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-531f41ec-9ea1-4628-83ac-ca4c295448bb tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:38.114695 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-8f2e38c3-5f92-47ce-9917-46c4437d26fe tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:38.119159 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-531f41ec-9ea1-4628-83ac-ca4c295448bb tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00" status: 200 len: 1555 microversion: 2.1 time: 0.225287 Jul 04 10:12:38.119729 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 241/479] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:37 2022] GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00 => generated 1555 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:38.122907 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-8f2e38c3-5f92-47ce-9917-46c4437d26fe tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1736 microversion: 2.1 time: 0.223898 Jul 04 10:12:38.123606 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 239/480] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:37 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1736 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:38.136675 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2a699e03-4530-4dfc-a007-3a48a99dd2a9 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:38.136675 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-2a699e03-4530-4dfc-a007-3a48a99dd2a9 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a936822b-ef8c-42ad-9510-194756830a00] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:38.143142 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2a699e03-4530-4dfc-a007-3a48a99dd2a9 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:38.143675 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2a699e03-4530-4dfc-a007-3a48a99dd2a9 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:38.144411 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2a699e03-4530-4dfc-a007-3a48a99dd2a9 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:38.144875 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2a699e03-4530-4dfc-a007-3a48a99dd2a9 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:38.227007 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-2a699e03-4530-4dfc-a007-3a48a99dd2a9 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094392 Jul 04 10:12:38.227830 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 242/481] 10.222.0.79 () {58 vars in 1274 bytes} [Mon Jul 4 10:12:38 2022] GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:12:39.141919 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-d06426c3-4ad8-47a6-9607-892dd8883a54 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:39.142532 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-d06426c3-4ad8-47a6-9607-892dd8883a54 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:39.155063 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d06426c3-4ad8-47a6-9607-892dd8883a54 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:39.155605 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d06426c3-4ad8-47a6-9607-892dd8883a54 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:39.156382 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d06426c3-4ad8-47a6-9607-892dd8883a54 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:39.156820 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d06426c3-4ad8-47a6-9607-892dd8883a54 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:39.171245 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-6e40a71e-af85-4769-9e2f-8f3296dded2a req-928354a6-f623-4109-a1a3-5ba2baf27251 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a936822b-ef8c-42ad-9510-194756830a00", "tag": "111fd0b9-55ad-4e25-93cf-69456c116c74"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:12:39.179552 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-6e40a71e-af85-4769-9e2f-8f3296dded2a req-928354a6-f623-4109-a1a3-5ba2baf27251 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:39.179988 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-6e40a71e-af85-4769-9e2f-8f3296dded2a req-928354a6-f623-4109-a1a3-5ba2baf27251 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:39.191407 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-6e40a71e-af85-4769-9e2f-8f3296dded2a req-928354a6-f623-4109-a1a3-5ba2baf27251 service nova] Creating event network-changed:111fd0b9-55ad-4e25-93cf-69456c116c74 for instance a936822b-ef8c-42ad-9510-194756830a00 on hv-cinder-84841 Jul 04 10:12:39.196658 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-6e40a71e-af85-4769-9e2f-8f3296dded2a req-928354a6-f623-4109-a1a3-5ba2baf27251 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029507 Jul 04 10:12:39.197262 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 243/482] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 10:12:39.388148 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-d06426c3-4ad8-47a6-9607-892dd8883a54 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:39.397326 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-d06426c3-4ad8-47a6-9607-892dd8883a54 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1736 microversion: 2.1 time: 0.259235 Jul 04 10:12:39.398135 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 240/483] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:39 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1736 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:40.416086 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-d8402f93-b8c9-45cb-90f2-ad15f34cdfb4 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:40.416775 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d8402f93-b8c9-45cb-90f2-ad15f34cdfb4 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:40.423627 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d8402f93-b8c9-45cb-90f2-ad15f34cdfb4 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:40.424065 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d8402f93-b8c9-45cb-90f2-ad15f34cdfb4 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:40.425067 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d8402f93-b8c9-45cb-90f2-ad15f34cdfb4 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:40.425510 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d8402f93-b8c9-45cb-90f2-ad15f34cdfb4 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:40.567873 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-d8402f93-b8c9-45cb-90f2-ad15f34cdfb4 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:40.578243 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-d8402f93-b8c9-45cb-90f2-ad15f34cdfb4 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1736 microversion: 2.1 time: 0.166926 Jul 04 10:12:40.578847 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 244/484] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:40 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:40.947247 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-48d700dc-393b-487d-abf6-1045da31d0c7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:40.948075 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-48d700dc-393b-487d-abf6-1045da31d0c7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:40.957324 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-48d700dc-393b-487d-abf6-1045da31d0c7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:40.957832 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-48d700dc-393b-487d-abf6-1045da31d0c7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:40.958592 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-48d700dc-393b-487d-abf6-1045da31d0c7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:40.959023 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-48d700dc-393b-487d-abf6-1045da31d0c7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:40.992170 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-48d700dc-393b-487d-abf6-1045da31d0c7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2/os-volume_attachments/51645fd5-c5ad-48c4-9a98-6511a001a07f" status: 200 len: 194 microversion: 2.20 time: 0.052111 Jul 04 10:12:40.992752 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 241/485] 10.222.0.79 () {60 vars in 1453 bytes} [Mon Jul 4 10:12:40 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2/os-volume_attachments/51645fd5-c5ad-48c4-9a98-6511a001a07f => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 10:12:41.062034 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-ea97c675-8479-4174-9781-a633c2118ddd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:41.062524 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-ea97c675-8479-4174-9781-a633c2118ddd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:41.069076 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ea97c675-8479-4174-9781-a633c2118ddd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:41.069521 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ea97c675-8479-4174-9781-a633c2118ddd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:41.070316 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ea97c675-8479-4174-9781-a633c2118ddd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:41.070746 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ea97c675-8479-4174-9781-a633c2118ddd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:41.154136 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.objects.instance [None req-ea97c675-8479-4174-9781-a633c2118ddd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lazy-loading 'services' on Instance uuid ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 {{(pid=117865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 10:12:41.230458 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-ea97c675-8479-4174-9781-a633c2118ddd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2/os-volume_attachments/51645fd5-c5ad-48c4-9a98-6511a001a07f" status: 202 len: 0 microversion: 2.20 time: 0.172320 Jul 04 10:12:41.231046 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 245/486] 10.222.0.79 () {60 vars in 1456 bytes} [Mon Jul 4 10:12:41 2022] DELETE /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2/os-volume_attachments/51645fd5-c5ad-48c4-9a98-6511a001a07f => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 04 10:12:41.239908 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-7058e7c2-198b-470c-894f-8634e327ddaf tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:41.240853 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-7058e7c2-198b-470c-894f-8634e327ddaf tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:41.247184 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7058e7c2-198b-470c-894f-8634e327ddaf tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:41.247624 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7058e7c2-198b-470c-894f-8634e327ddaf tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:41.248368 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7058e7c2-198b-470c-894f-8634e327ddaf tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:41.248822 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7058e7c2-198b-470c-894f-8634e327ddaf tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:41.279307 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-7058e7c2-198b-470c-894f-8634e327ddaf tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043712 Jul 04 10:12:41.279884 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 242/487] 10.222.0.79 () {60 vars in 1342 bytes} [Mon Jul 4 10:12:41 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 10:12:41.606436 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-3770b917-cb54-4091-b2c8-ae991ecf4f2c tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:41.607577 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-3770b917-cb54-4091-b2c8-ae991ecf4f2c tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:41.616574 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3770b917-cb54-4091-b2c8-ae991ecf4f2c tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:41.617022 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3770b917-cb54-4091-b2c8-ae991ecf4f2c tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:41.617820 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3770b917-cb54-4091-b2c8-ae991ecf4f2c tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:41.618253 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3770b917-cb54-4091-b2c8-ae991ecf4f2c tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:41.748002 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-3770b917-cb54-4091-b2c8-ae991ecf4f2c tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:41.756453 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-3770b917-cb54-4091-b2c8-ae991ecf4f2c tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1736 microversion: 2.1 time: 0.157146 Jul 04 10:12:41.757028 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 246/488] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:41 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:42.295434 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-5c2447f0-929f-4e2b-b2eb-0f2c31b38d5c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:42.296822 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-5c2447f0-929f-4e2b-b2eb-0f2c31b38d5c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:42.304679 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5c2447f0-929f-4e2b-b2eb-0f2c31b38d5c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:42.305128 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5c2447f0-929f-4e2b-b2eb-0f2c31b38d5c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:42.305919 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5c2447f0-929f-4e2b-b2eb-0f2c31b38d5c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:42.306352 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5c2447f0-929f-4e2b-b2eb-0f2c31b38d5c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:42.336572 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-5c2447f0-929f-4e2b-b2eb-0f2c31b38d5c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048176 Jul 04 10:12:42.337140 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 243/489] 10.222.0.79 () {60 vars in 1342 bytes} [Mon Jul 4 10:12:42 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 10:12:42.773061 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-122b0e17-58a7-4bf9-89ce-3352c39fcf49 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:42.773909 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-122b0e17-58a7-4bf9-89ce-3352c39fcf49 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:42.780669 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-122b0e17-58a7-4bf9-89ce-3352c39fcf49 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:42.781108 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-122b0e17-58a7-4bf9-89ce-3352c39fcf49 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:42.781900 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-122b0e17-58a7-4bf9-89ce-3352c39fcf49 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:42.782322 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-122b0e17-58a7-4bf9-89ce-3352c39fcf49 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:42.915087 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-122b0e17-58a7-4bf9-89ce-3352c39fcf49 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:42.926524 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-122b0e17-58a7-4bf9-89ce-3352c39fcf49 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1736 microversion: 2.1 time: 0.157296 Jul 04 10:12:42.927116 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 247/490] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:42 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:43.352045 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-64ed8ef8-4b91-47d6-b177-73fbc8c770b7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:43.352963 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-64ed8ef8-4b91-47d6-b177-73fbc8c770b7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:43.359690 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-64ed8ef8-4b91-47d6-b177-73fbc8c770b7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:43.360172 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-64ed8ef8-4b91-47d6-b177-73fbc8c770b7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:43.361051 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-64ed8ef8-4b91-47d6-b177-73fbc8c770b7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:43.361488 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-64ed8ef8-4b91-47d6-b177-73fbc8c770b7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:43.394650 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-64ed8ef8-4b91-47d6-b177-73fbc8c770b7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046698 Jul 04 10:12:43.395124 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 244/491] 10.222.0.79 () {60 vars in 1342 bytes} [Mon Jul 4 10:12:43 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 10:12:43.947986 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-4ea92044-1611-444b-a4ea-e60edc910d86 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:43.948988 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-4ea92044-1611-444b-a4ea-e60edc910d86 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:43.958939 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4ea92044-1611-444b-a4ea-e60edc910d86 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:43.959378 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4ea92044-1611-444b-a4ea-e60edc910d86 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:43.960132 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4ea92044-1611-444b-a4ea-e60edc910d86 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:43.960553 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4ea92044-1611-444b-a4ea-e60edc910d86 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:44.095102 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-4ea92044-1611-444b-a4ea-e60edc910d86 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:44.097584 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:12:44.104655 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-4ea92044-1611-444b-a4ea-e60edc910d86 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1736 microversion: 2.1 time: 0.163341 Jul 04 10:12:44.105212 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 248/492] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:43 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:44.406963 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-ecfe63e9-1ffb-4d52-a62d-a66fab3ac1b9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:44.407771 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-ecfe63e9-1ffb-4d52-a62d-a66fab3ac1b9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:44.414450 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ecfe63e9-1ffb-4d52-a62d-a66fab3ac1b9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:44.414914 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ecfe63e9-1ffb-4d52-a62d-a66fab3ac1b9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:44.415659 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ecfe63e9-1ffb-4d52-a62d-a66fab3ac1b9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:44.416086 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ecfe63e9-1ffb-4d52-a62d-a66fab3ac1b9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:44.449467 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-ecfe63e9-1ffb-4d52-a62d-a66fab3ac1b9 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046642 Jul 04 10:12:44.454911 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 245/493] 10.222.0.79 () {60 vars in 1342 bytes} [Mon Jul 4 10:12:44 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:44.509490 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-fc2254bd-3184-464f-b945-61b6e5223b4f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:44.510083 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-fc2254bd-3184-464f-b945-61b6e5223b4f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:44.517126 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fc2254bd-3184-464f-b945-61b6e5223b4f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:44.517595 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fc2254bd-3184-464f-b945-61b6e5223b4f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:44.518372 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fc2254bd-3184-464f-b945-61b6e5223b4f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:44.518796 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fc2254bd-3184-464f-b945-61b6e5223b4f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:44.543177 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-fc2254bd-3184-464f-b945-61b6e5223b4f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Going to try to terminate instance {{(pid=117865) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 10:12:44.622445 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-fc2254bd-3184-464f-b945-61b6e5223b4f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 204 len: 0 microversion: 2.20 time: 0.116529 Jul 04 10:12:44.623048 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 249/494] 10.222.0.79 () {60 vars in 1279 bytes} [Mon Jul 4 10:12:44 2022] DELETE /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 04 10:12:44.631990 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-ce1c9117-6e1e-4841-9e5c-1ad135e17cdd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:44.632590 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-ce1c9117-6e1e-4841-9e5c-1ad135e17cdd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:44.638877 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ce1c9117-6e1e-4841-9e5c-1ad135e17cdd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:44.639319 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ce1c9117-6e1e-4841-9e5c-1ad135e17cdd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:44.640082 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ce1c9117-6e1e-4841-9e5c-1ad135e17cdd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:44.640513 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ce1c9117-6e1e-4841-9e5c-1ad135e17cdd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:44.771820 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-ce1c9117-6e1e-4841-9e5c-1ad135e17cdd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:44.781424 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-ce1c9117-6e1e-4841-9e5c-1ad135e17cdd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:44.782951 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-ce1c9117-6e1e-4841-9e5c-1ad135e17cdd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:44.784112 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-ce1c9117-6e1e-4841-9e5c-1ad135e17cdd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1721 microversion: 2.20 time: 0.156141 Jul 04 10:12:44.784670 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 246/495] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:12:44 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 10:12:45.122877 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-26486aad-cd2f-4f9b-840d-d10dd2518552 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:45.123569 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-26486aad-cd2f-4f9b-840d-d10dd2518552 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:45.130731 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-26486aad-cd2f-4f9b-840d-d10dd2518552 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:45.131181 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-26486aad-cd2f-4f9b-840d-d10dd2518552 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:45.131971 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-26486aad-cd2f-4f9b-840d-d10dd2518552 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:45.132408 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-26486aad-cd2f-4f9b-840d-d10dd2518552 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:45.271568 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-26486aad-cd2f-4f9b-840d-d10dd2518552 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:45.280005 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-26486aad-cd2f-4f9b-840d-d10dd2518552 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1716 microversion: 2.1 time: 0.161446 Jul 04 10:12:45.280593 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 250/496] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:45 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1716 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:45.389657 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-a1281e82-696e-4742-a4f8-897afaa2bce9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:45.390210 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-a1281e82-696e-4742-a4f8-897afaa2bce9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:45.396964 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a1281e82-696e-4742-a4f8-897afaa2bce9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:45.397403 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a1281e82-696e-4742-a4f8-897afaa2bce9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:45.398217 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a1281e82-696e-4742-a4f8-897afaa2bce9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:45.398651 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a1281e82-696e-4742-a4f8-897afaa2bce9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:45.522205 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.wsgi [None req-a1281e82-696e-4742-a4f8-897afaa2bce9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] HTTP exception thrown: Cannot 'detach_volume' instance cae1c9c4-3ee8-4aae-8911-21df5f3c37df while it is in vm_state rescued Jul 04 10:12:45.523826 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-a1281e82-696e-4742-a4f8-897afaa2bce9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Request method failure captured: Jul 04 10:12:45.523826 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: request: DELETE /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df/os-volume_attachments/e47af670-35fc-4e8b-a711-288429e75bb4 HTTP/1.1 Jul 04 10:12:45.523826 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept: application/json Jul 04 10:12:45.523826 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept-Encoding: identity Jul 04 10:12:45.523826 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Connection: close Jul 04 10:12:45.523826 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Length: 0 Jul 04 10:12:45.523826 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Type: application/json Jul 04 10:12:45.523826 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Host: 10.222.0.79 Jul 04 10:12:45.523826 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Openstack-System-Scope: None Jul 04 10:12:45.523826 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: User-Agent: python-urllib3/1.26.9 Jul 04 10:12:45.523826 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Auth-Token: gAAAAABiwrwoMkd-FZrLDL5-aiRWEi2tqP5Y9aVcYuzksosW1VeQBqKJ-M1OWBbervr9826WxI3yk8EyOa512EHvhSat68LXFU2P2jP3EEjFTBdF0aQwIXnaeXxxjkpaGKt1qebXvZBxiG3u8qxwquzbjrAQDdrYWk79BjtmAHI2EEpansDRzwg Jul 04 10:12:45.523826 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Id: None Jul 04 10:12:45.523826 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Name: None Jul 04 10:12:45.523826 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Identity-Status: Confirmed Jul 04 10:12:45.523826 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Is-Admin-Project: True Jul 04 10:12:45.523826 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Id: default Jul 04 10:12:45.523826 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Name: Default Jul 04 10:12:45.523826 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Id: 7f101e48ae9b4936a6d1b7bae000d7e1 Jul 04 10:12:45.523826 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1112364786 Jul 04 10:12:45.523826 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Role: reader,member Jul 04 10:12:45.523826 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Roles: reader,member Jul 04 10:12:45.525308 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7f101e48ae9b4936a6d1b7bae000d7e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7f101e48ae9b4936a6d1b7bae000d7e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7f101e48ae9b4936a6d1b7bae000d7e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7f101e48ae9b4936a6d1b7bae000d7e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:12:45.525308 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1112364786 Jul 04 10:12:45.525308 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Id: 7f101e48ae9b4936a6d1b7bae000d7e1 Jul 04 10:12:45.525308 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1112364786 Jul 04 10:12:45.525308 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User: tempest-ServerRescueNegativeTestJSON-1112364786-project Jul 04 10:12:45.525308 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Id: default Jul 04 10:12:45.525308 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Name: Default Jul 04 10:12:45.525308 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Id: fc9c26318d6c41f6b9455153f0d0e55b Jul 04 10:12:45.525308 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1112364786-project Jul 04 10:12:45.525308 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: method: > Jul 04 10:12:45.525308 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: exception: Cannot 'detach_volume' instance cae1c9c4-3ee8-4aae-8911-21df5f3c37df while it is in vm_state rescued Jul 04 10:12:45.526307 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: action_args: {'server_id': 'cae1c9c4-3ee8-4aae-8911-21df5f3c37df', 'id': 'e47af670-35fc-4e8b-a711-288429e75bb4'} Jul 04 10:12:45.526307 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:12:45.526307 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:12:45.526307 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 04 10:12:45.526307 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 04 10:12:45.526307 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 04 10:12:45.526307 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 04 10:12:45.526307 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 04 10:12:45.526307 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 04 10:12:45.526307 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cae1c9c4-3ee8-4aae-8911-21df5f3c37df in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 04 10:12:45.526307 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:12:45.526307 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:12:45.526307 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:12:45.526307 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:12:45.526307 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:12:45.526307 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:12:45.526307 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:12:45.526307 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:12:45.526307 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:12:45.526307 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:12:45.528558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 04 10:12:45.528558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 04 10:12:45.528558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 04 10:12:45.528558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 04 10:12:45.528558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance cae1c9c4-3ee8-4aae-8911-21df5f3c37df while it is in vm_state rescued Jul 04 10:12:45.528558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:12:45.528558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:12:45.528558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:12:45.528558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:12:45.528558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:12:45.528558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:12:45.528558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:12:45.528558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:12:45.528558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance cae1c9c4-3ee8-4aae-8911-21df5f3c37df while it is in vm_state rescued Jul 04 10:12:45.528558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:12:45.528558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-a1281e82-696e-4742-a4f8-897afaa2bce9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Returning 409 to user: Cannot 'detach_volume' instance cae1c9c4-3ee8-4aae-8911-21df5f3c37df while it is in vm_state rescued {{(pid=117866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:12:45.529975 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-a1281e82-696e-4742-a4f8-897afaa2bce9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "DELETE /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df/os-volume_attachments/e47af670-35fc-4e8b-a711-288429e75bb4" status: 409 len: 152 microversion: 2.1 time: 0.139721 Jul 04 10:12:45.529975 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 247/497] 10.222.0.79 () {58 vars in 1415 bytes} [Mon Jul 4 10:12:45 2022] DELETE /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df/os-volume_attachments/e47af670-35fc-4e8b-a711-288429e75bb4 => generated 152 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 04 10:12:45.535629 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-23fb73dc-df72-417c-bc43-cbd2b2138823 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:12:45.536369 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-23fb73dc-df72-417c-bc43-cbd2b2138823 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:45.543058 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-23fb73dc-df72-417c-bc43-cbd2b2138823 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:45.543501 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-23fb73dc-df72-417c-bc43-cbd2b2138823 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:45.544258 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-23fb73dc-df72-417c-bc43-cbd2b2138823 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:45.544690 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-23fb73dc-df72-417c-bc43-cbd2b2138823 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:45.619665 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-23fb73dc-df72-417c-bc43-cbd2b2138823 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "POST /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df/action" status: 202 len: 0 microversion: 2.1 time: 0.087670 Jul 04 10:12:45.621272 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 251/498] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Jul 4 10:12:45 2022] POST /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 04 10:12:45.630617 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-dad70df3-9f85-4c20-84ff-79d7acb90b66 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:45.631196 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-dad70df3-9f85-4c20-84ff-79d7acb90b66 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:45.637228 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-dad70df3-9f85-4c20-84ff-79d7acb90b66 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:45.637697 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-dad70df3-9f85-4c20-84ff-79d7acb90b66 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:45.638451 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-dad70df3-9f85-4c20-84ff-79d7acb90b66 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:45.638877 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-dad70df3-9f85-4c20-84ff-79d7acb90b66 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:45.808177 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-283c8504-fc97-4de6-8ed6-43aba6ea59d7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:45.808871 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-283c8504-fc97-4de6-8ed6-43aba6ea59d7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:45.815893 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-283c8504-fc97-4de6-8ed6-43aba6ea59d7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:45.816340 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-283c8504-fc97-4de6-8ed6-43aba6ea59d7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:45.817129 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-283c8504-fc97-4de6-8ed6-43aba6ea59d7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:45.817605 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-283c8504-fc97-4de6-8ed6-43aba6ea59d7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:46.055620 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-dad70df3-9f85-4c20-84ff-79d7acb90b66 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:46.062641 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-283c8504-fc97-4de6-8ed6-43aba6ea59d7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:46.064012 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-dad70df3-9f85-4c20-84ff-79d7acb90b66 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1724 microversion: 2.1 time: 0.437591 Jul 04 10:12:46.064550 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 248/499] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:45 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1724 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:46.071222 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-283c8504-fc97-4de6-8ed6-43aba6ea59d7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:46.072706 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-283c8504-fc97-4de6-8ed6-43aba6ea59d7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:46.073896 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-283c8504-fc97-4de6-8ed6-43aba6ea59d7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1721 microversion: 2.20 time: 0.270127 Jul 04 10:12:46.074438 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 252/500] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:12:45 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1721 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 10:12:47.082595 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-fb2f2e6e-6360-469d-92c0-0c8b644ad7d4 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:47.083201 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-fb2f2e6e-6360-469d-92c0-0c8b644ad7d4 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:47.089999 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-fb2f2e6e-6360-469d-92c0-0c8b644ad7d4 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:47.090711 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-fb2f2e6e-6360-469d-92c0-0c8b644ad7d4 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:47.092203 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-fb2f2e6e-6360-469d-92c0-0c8b644ad7d4 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:47.092928 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-fb2f2e6e-6360-469d-92c0-0c8b644ad7d4 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:47.094181 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-a8aaa80a-1aed-49b3-a671-893f12b4e69e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:47.094890 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-a8aaa80a-1aed-49b3-a671-893f12b4e69e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:47.102990 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a8aaa80a-1aed-49b3-a671-893f12b4e69e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:47.103574 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a8aaa80a-1aed-49b3-a671-893f12b4e69e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:47.104462 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a8aaa80a-1aed-49b3-a671-893f12b4e69e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:47.105074 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a8aaa80a-1aed-49b3-a671-893f12b4e69e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:47.349538 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-a8aaa80a-1aed-49b3-a671-893f12b4e69e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:47.359003 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-fb2f2e6e-6360-469d-92c0-0c8b644ad7d4 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:47.359325 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-a8aaa80a-1aed-49b3-a671-893f12b4e69e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:47.360970 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-a8aaa80a-1aed-49b3-a671-893f12b4e69e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:47.362184 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-a8aaa80a-1aed-49b3-a671-893f12b4e69e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1721 microversion: 2.20 time: 0.273702 Jul 04 10:12:47.362719 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 253/501] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:12:47 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1721 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:12:47.373504 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-fb2f2e6e-6360-469d-92c0-0c8b644ad7d4 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1724 microversion: 2.1 time: 0.290823 Jul 04 10:12:47.373504 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 249/502] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:47 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1724 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:47.674193 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-cc6423bd-f686-4b7b-9755-ad3595bab7e2 req-b3becccc-2dae-425f-ba66-6ccea06f9a00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2", "name": "network-vif-deleted", "tag": "ca00e905-cd23-4f89-b9a3-2e4d9b7e6b31"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:12:47.682240 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-cc6423bd-f686-4b7b-9755-ad3595bab7e2 req-b3becccc-2dae-425f-ba66-6ccea06f9a00 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:47.682677 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-cc6423bd-f686-4b7b-9755-ad3595bab7e2 req-b3becccc-2dae-425f-ba66-6ccea06f9a00 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:47.686360 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell1:SELECT=100 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:12:47.694458 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-cc6423bd-f686-4b7b-9755-ad3595bab7e2 req-b3becccc-2dae-425f-ba66-6ccea06f9a00 service nova] Creating event network-vif-deleted:ca00e905-cd23-4f89-b9a3-2e4d9b7e6b31 for instance ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 on hv-cinder-84841 Jul 04 10:12:47.699631 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-cc6423bd-f686-4b7b-9755-ad3595bab7e2 req-b3becccc-2dae-425f-ba66-6ccea06f9a00 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029094 Jul 04 10:12:47.700446 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 250/503] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:12:48.380952 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f7400dce-f707-4b51-a594-af050005e436 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:48.381553 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f7400dce-f707-4b51-a594-af050005e436 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:48.387759 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-b608ca96-6bd8-47e9-bb21-83ac4a8e5b37 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:48.388529 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-b608ca96-6bd8-47e9-bb21-83ac4a8e5b37 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:48.389725 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f7400dce-f707-4b51-a594-af050005e436 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:48.390178 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f7400dce-f707-4b51-a594-af050005e436 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:48.390949 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f7400dce-f707-4b51-a594-af050005e436 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:48.391745 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f7400dce-f707-4b51-a594-af050005e436 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:48.395185 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b608ca96-6bd8-47e9-bb21-83ac4a8e5b37 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:48.395755 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b608ca96-6bd8-47e9-bb21-83ac4a8e5b37 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:48.396615 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b608ca96-6bd8-47e9-bb21-83ac4a8e5b37 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:48.397125 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b608ca96-6bd8-47e9-bb21-83ac4a8e5b37 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:48.495649 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-f7400dce-f707-4b51-a594-af050005e436 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:48.504299 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-f7400dce-f707-4b51-a594-af050005e436 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:48.506091 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-f7400dce-f707-4b51-a594-af050005e436 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:48.507704 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f7400dce-f707-4b51-a594-af050005e436 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1653 microversion: 2.20 time: 0.130624 Jul 04 10:12:48.508337 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 254/504] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:12:48 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1653 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:12:48.567869 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-b608ca96-6bd8-47e9-bb21-83ac4a8e5b37 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:48.576288 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-b608ca96-6bd8-47e9-bb21-83ac4a8e5b37 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1724 microversion: 2.1 time: 0.192806 Jul 04 10:12:48.576893 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 251/505] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:48 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:12:49.531043 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-c4800328-022f-4a0e-bdbd-51b85e5ecca6 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:49.531951 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-c4800328-022f-4a0e-bdbd-51b85e5ecca6 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:49.540533 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c4800328-022f-4a0e-bdbd-51b85e5ecca6 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:49.540974 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c4800328-022f-4a0e-bdbd-51b85e5ecca6 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:49.541828 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c4800328-022f-4a0e-bdbd-51b85e5ecca6 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:49.542263 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c4800328-022f-4a0e-bdbd-51b85e5ecca6 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:49.581798 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c4800328-022f-4a0e-bdbd-51b85e5ecca6 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:49.582245 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c4800328-022f-4a0e-bdbd-51b85e5ecca6 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:49.582732 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.objects.instance [None req-c4800328-022f-4a0e-bdbd-51b85e5ecca6 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lazy-loading 'fault' on Instance uuid ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 {{(pid=117865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 10:12:49.592930 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-8982b7d4-9faf-4697-bc48-76d12bce88fa tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:49.593568 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-8982b7d4-9faf-4697-bc48-76d12bce88fa tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:49.600419 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8982b7d4-9faf-4697-bc48-76d12bce88fa tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:49.600871 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8982b7d4-9faf-4697-bc48-76d12bce88fa tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:49.601641 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8982b7d4-9faf-4697-bc48-76d12bce88fa tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:49.602109 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8982b7d4-9faf-4697-bc48-76d12bce88fa tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:49.625977 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-c4800328-022f-4a0e-bdbd-51b85e5ecca6 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:49.634413 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-c4800328-022f-4a0e-bdbd-51b85e5ecca6 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:49.636015 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-c4800328-022f-4a0e-bdbd-51b85e5ecca6 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:49.637288 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-c4800328-022f-4a0e-bdbd-51b85e5ecca6 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 200 len: 1371 microversion: 2.20 time: 0.112802 Jul 04 10:12:49.637974 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 255/506] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:12:49 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 1371 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:12:49.748247 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-8982b7d4-9faf-4697-bc48-76d12bce88fa tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:49.756439 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-8982b7d4-9faf-4697-bc48-76d12bce88fa tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1730 microversion: 2.1 time: 0.167622 Jul 04 10:12:49.756961 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 252/507] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:12:49 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:12:49.773562 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-85bba055-8a4d-4208-9bdf-34c8b7f2509e tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:49.774080 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-85bba055-8a4d-4208-9bdf-34c8b7f2509e tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:49.780356 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-85bba055-8a4d-4208-9bdf-34c8b7f2509e tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:49.780799 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-85bba055-8a4d-4208-9bdf-34c8b7f2509e tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:49.781641 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-85bba055-8a4d-4208-9bdf-34c8b7f2509e tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:49.782011 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-85bba055-8a4d-4208-9bdf-34c8b7f2509e tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:49.859573 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-85bba055-8a4d-4208-9bdf-34c8b7f2509e tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090142 Jul 04 10:12:49.860170 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 256/508] 10.222.0.79 () {58 vars in 1274 bytes} [Mon Jul 4 10:12:49 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 10:12:50.656176 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-6afc006f-c08b-47a8-982a-87166487f529 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:50.656742 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-6afc006f-c08b-47a8-982a-87166487f529 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:50.663191 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-6afc006f-c08b-47a8-982a-87166487f529 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:50.663633 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-6afc006f-c08b-47a8-982a-87166487f529 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:50.664391 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-6afc006f-c08b-47a8-982a-87166487f529 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:50.664845 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-6afc006f-c08b-47a8-982a-87166487f529 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:50.678366 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.wsgi [None req-6afc006f-c08b-47a8-982a-87166487f529 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] HTTP exception thrown: Instance ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 could not be found. Jul 04 10:12:50.680009 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-6afc006f-c08b-47a8-982a-87166487f529 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Request method failure captured: Jul 04 10:12:50.680009 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: request: GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 HTTP/1.1 Jul 04 10:12:50.680009 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept: application/json Jul 04 10:12:50.680009 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept-Encoding: identity Jul 04 10:12:50.680009 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Connection: close Jul 04 10:12:50.680009 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Length: 0 Jul 04 10:12:50.680009 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Type: application/json Jul 04 10:12:50.680009 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Host: 10.222.0.79 Jul 04 10:12:50.680009 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Openstack-System-Scope: None Jul 04 10:12:50.680009 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: User-Agent: python-urllib3/1.26.9 Jul 04 10:12:50.680009 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Auth-Token: gAAAAABiwrwsRjPFfauJ0cIzMInBcEwtVng9DptjB6OPKNfVygqH0eCVAApJP28q3UyvJOOyf4svKw5vjRunfIOFo_QaQJeMPe34oQOw61-tXGDN64BxOzNizWTxQ-yvVdFgXtg5_SGTWj_hasuWYs2yuFpQLMypxGx5O68Q-1MWK1ukE3GPXaM Jul 04 10:12:50.680009 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Id: None Jul 04 10:12:50.680009 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Name: None Jul 04 10:12:50.680009 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Identity-Status: Confirmed Jul 04 10:12:50.680009 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Is-Admin-Project: True Jul 04 10:12:50.680009 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Openstack-Nova-Api-Version: 2.20 Jul 04 10:12:50.680009 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Id: default Jul 04 10:12:50.680009 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Name: Default Jul 04 10:12:50.680009 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Id: b852926ec18f4dc695da5ec1c5582f48 Jul 04 10:12:50.680009 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1729716423 Jul 04 10:12:50.680009 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Role: reader,member Jul 04 10:12:50.680009 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Roles: reader,member Jul 04 10:12:50.681368 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b852926ec18f4dc695da5ec1c5582f48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b852926ec18f4dc695da5ec1c5582f48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b852926ec18f4dc695da5ec1c5582f48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b852926ec18f4dc695da5ec1c5582f48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:12:50.681368 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1729716423 Jul 04 10:12:50.681368 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Id: b852926ec18f4dc695da5ec1c5582f48 Jul 04 10:12:50.681368 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1729716423 Jul 04 10:12:50.681368 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User: tempest-AttachVolumeShelveTestJSON-1729716423-project Jul 04 10:12:50.681368 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Id: default Jul 04 10:12:50.681368 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Name: Default Jul 04 10:12:50.681368 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Id: 1c05b9b08df0437f9b0abb167d17aa56 Jul 04 10:12:50.681368 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1729716423-project Jul 04 10:12:50.681368 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: method: > Jul 04 10:12:50.681368 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: exception: Instance ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 could not be found. Jul 04 10:12:50.681368 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: action_args: {'id': 'ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2'} Jul 04 10:12:50.682180 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:12:50.682180 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:12:50.682180 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:12:50.682180 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:12:50.682180 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:12:50.682180 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:12:50.682180 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:12:50.682180 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:12:50.682180 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:12:50.682180 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:12:50.682180 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 could not be found. Jul 04 10:12:50.682180 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:12:50.682180 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:12:50.682180 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:12:50.682180 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:12:50.682180 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:12:50.682180 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:12:50.682180 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:12:50.682180 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:12:50.682180 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:12:50.683308 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:12:50.683308 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 10:12:50.683308 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 10:12:50.683308 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:12:50.683308 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:12:50.683308 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:12:50.683308 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:12:50.683308 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 could not be found. Jul 04 10:12:50.683308 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:12:50.683308 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:12:50.683308 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:12:50.683308 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:12:50.683308 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:12:50.683308 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:12:50.683308 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:12:50.683308 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:12:50.683308 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 could not be found. Jul 04 10:12:50.683308 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:12:50.684430 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-6afc006f-c08b-47a8-982a-87166487f529 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Returning 404 to user: Instance ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 could not be found. {{(pid=117866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:12:50.684430 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-6afc006f-c08b-47a8-982a-87166487f529 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 404 len: 111 microversion: 2.20 time: 0.029390 Jul 04 10:12:50.684430 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 253/509] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:12:50 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 04 10:12:50.691326 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-3654424e-32d7-4131-9cb1-8b4c7475ad3a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '.version_select at 0x7f280817baf0>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:50.711569 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-3654424e-32d7-4131-9cb1-8b4c7475ad3a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-457655165" status: 204 len: 0 microversion: 2.20 time: 0.024602 Jul 04 10:12:50.712092 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 257/510] 10.222.0.79 () {60 vars in 1258 bytes} [Mon Jul 4 10:12:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-457655165 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 04 10:12:50.760431 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-ebcf3329-b77a-4b99-a1a7-790f0c6eee9b req-cefe56f6-7018-4532-997a-7b6b0a353213 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cae1c9c4-3ee8-4aae-8911-21df5f3c37df", "tag": "983beb0b-565d-4f4f-b77c-f373196c5bdc"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:12:50.772080 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-ebcf3329-b77a-4b99-a1a7-790f0c6eee9b req-cefe56f6-7018-4532-997a-7b6b0a353213 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:50.773979 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-ebcf3329-b77a-4b99-a1a7-790f0c6eee9b req-cefe56f6-7018-4532-997a-7b6b0a353213 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:50.793176 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-ebcf3329-b77a-4b99-a1a7-790f0c6eee9b req-cefe56f6-7018-4532-997a-7b6b0a353213 service nova] Creating event network-changed:983beb0b-565d-4f4f-b77c-f373196c5bdc for instance cae1c9c4-3ee8-4aae-8911-21df5f3c37df on hv-cinder-84841 Jul 04 10:12:50.800735 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-ebcf3329-b77a-4b99-a1a7-790f0c6eee9b req-cefe56f6-7018-4532-997a-7b6b0a353213 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043425 Jul 04 10:12:50.801427 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 254/511] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:12:51.377078 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e5a2aeab-7781-4a68-a66e-29512b88b073 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Action: 'create', calling method: .version_select at 0x7f2802fe9430>, body: {"keypair": {"name": "tempest-keypair-1741992777", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDIJJpbtj7MvkZVLA5NQNlyrM1YkfoCNd3eDvgBFdMnrC1RgEq6vtsW8EKuIPdytr8s9iNhMA2f9bOUTX1YHsRC2+nIlsbK/1NNM79htsVDwhw2X+LsbsVBVaKmeZtWag=="}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:12:51.392614 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-e5a2aeab-7781-4a68-a66e-29512b88b073 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Getting quotas for project b852926ec18f4dc695da5ec1c5582f48. Resources: {'key_pairs'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 10:12:51.397160 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-e5a2aeab-7781-4a68-a66e-29512b88b073 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Getting quotas for user 1c05b9b08df0437f9b0abb167d17aa56 and project b852926ec18f4dc695da5ec1c5582f48. Resources: {'key_pairs'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 10:12:51.420094 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-e5a2aeab-7781-4a68-a66e-29512b88b073 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.046949 Jul 04 10:12:51.420705 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 258/512] 10.222.0.79 () {62 vars in 1199 bytes} [Mon Jul 4 10:12:51 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 04 10:12:52.819428 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-98761bb1-6c66-4baa-8568-79ef9ecb09bd req-3dfda75c-ef19-40e5-b032-1c2b992c0380 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cae1c9c4-3ee8-4aae-8911-21df5f3c37df", "tag": "983beb0b-565d-4f4f-b77c-f373196c5bdc"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:12:52.828803 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-98761bb1-6c66-4baa-8568-79ef9ecb09bd req-3dfda75c-ef19-40e5-b032-1c2b992c0380 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:52.829251 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-98761bb1-6c66-4baa-8568-79ef9ecb09bd req-3dfda75c-ef19-40e5-b032-1c2b992c0380 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:52.841497 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-98761bb1-6c66-4baa-8568-79ef9ecb09bd req-3dfda75c-ef19-40e5-b032-1c2b992c0380 service nova] Creating event network-changed:983beb0b-565d-4f4f-b77c-f373196c5bdc for instance cae1c9c4-3ee8-4aae-8911-21df5f3c37df on hv-cinder-84841 Jul 04 10:12:52.846514 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-98761bb1-6c66-4baa-8568-79ef9ecb09bd req-3dfda75c-ef19-40e5-b032-1c2b992c0380 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031367 Jul 04 10:12:52.847104 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 255/513] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:12:52.960370 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-3f45d103-f6bc-4287-a1e8-2e9a9498c01b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1595325372", "imageRef": "80bd29b0-b77c-4611-be31-69ca559a2d2a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2931c1fd-bb14-4bfb-ad76-5fa1ab8e6e1a"}], "security_groups": [{"name": "tempest-securitygroup--938218929"}], "key_name": "tempest-keypair-1741992777", "user_data": "}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:12:53.114979 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.network.neutron [None req-3f45d103-f6bc-4287-a1e8-2e9a9498c01b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] validate_networks() for [('2931c1fd-bb14-4bfb-ad76-5fa1ab8e6e1a', None, None, None, None, None)] {{(pid=117865) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 10:12:53.717722 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-3f45d103-f6bc-4287-a1e8-2e9a9498c01b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Flavor limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 10:12:53.718190 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-3f45d103-f6bc-4287-a1e8-2e9a9498c01b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Image limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 10:12:53.718768 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-3f45d103-f6bc-4287-a1e8-2e9a9498c01b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Flavor pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 10:12:53.719379 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-3f45d103-f6bc-4287-a1e8-2e9a9498c01b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Image pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 10:12:53.719929 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-3f45d103-f6bc-4287-a1e8-2e9a9498c01b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 10:12:53.730825 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3f45d103-f6bc-4287-a1e8-2e9a9498c01b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:53.731267 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3f45d103-f6bc-4287-a1e8-2e9a9498c01b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:53.732062 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3f45d103-f6bc-4287-a1e8-2e9a9498c01b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:53.732492 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3f45d103-f6bc-4287-a1e8-2e9a9498c01b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:53.749598 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-3f45d103-f6bc-4287-a1e8-2e9a9498c01b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Getting quotas for project b852926ec18f4dc695da5ec1c5582f48. Resources: {'cores', 'ram', 'instances'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 10:12:53.754271 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-3f45d103-f6bc-4287-a1e8-2e9a9498c01b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Getting quotas for user 1c05b9b08df0437f9b0abb167d17aa56 and project b852926ec18f4dc695da5ec1c5582f48. Resources: {'cores', 'ram', 'instances'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 10:12:53.766725 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-3f45d103-f6bc-4287-a1e8-2e9a9498c01b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Going to run 1 instances... {{(pid=117865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 10:12:53.769010 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-3f45d103-f6bc-4287-a1e8-2e9a9498c01b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80bd29b0-b77c-4611-be31-69ca559a2d2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 10:12:53.823244 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-3f45d103-f6bc-4287-a1e8-2e9a9498c01b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.867974 Jul 04 10:12:53.823871 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 259/514] 10.222.0.79 () {62 vars in 1187 bytes} [Mon Jul 4 10:12:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 04 10:12:53.835136 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-a1f05fb9-01ea-4e9c-8009-b6bdb496c21a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:53.835824 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-a1f05fb9-01ea-4e9c-8009-b6bdb496c21a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:53.891006 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-a1f05fb9-01ea-4e9c-8009-b6bdb496c21a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:53.898844 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-a1f05fb9-01ea-4e9c-8009-b6bdb496c21a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:53.900454 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-a1f05fb9-01ea-4e9c-8009-b6bdb496c21a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:53.901389 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-a1f05fb9-01ea-4e9c-8009-b6bdb496c21a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1282 microversion: 2.20 time: 0.071075 Jul 04 10:12:53.901963 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 256/515] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:12:53 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1282 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:12:54.920782 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-79fb2b7e-97de-4ca0-96af-eb6a82b29fc6 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:54.921731 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-79fb2b7e-97de-4ca0-96af-eb6a82b29fc6 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:54.929016 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-79fb2b7e-97de-4ca0-96af-eb6a82b29fc6 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:54.929458 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-79fb2b7e-97de-4ca0-96af-eb6a82b29fc6 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:54.930283 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-79fb2b7e-97de-4ca0-96af-eb6a82b29fc6 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:54.930708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-79fb2b7e-97de-4ca0-96af-eb6a82b29fc6 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:55.008125 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-79fb2b7e-97de-4ca0-96af-eb6a82b29fc6 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:55.016516 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-79fb2b7e-97de-4ca0-96af-eb6a82b29fc6 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:55.017999 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-79fb2b7e-97de-4ca0-96af-eb6a82b29fc6 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:55.019098 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-79fb2b7e-97de-4ca0-96af-eb6a82b29fc6 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1352 microversion: 2.20 time: 0.103397 Jul 04 10:12:55.019643 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 260/516] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:12:54 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:12:56.038700 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-7a89db44-d18e-42f5-bbc5-1c68c4846ab5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:56.039278 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-7a89db44-d18e-42f5-bbc5-1c68c4846ab5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:56.046517 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7a89db44-d18e-42f5-bbc5-1c68c4846ab5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:56.046956 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7a89db44-d18e-42f5-bbc5-1c68c4846ab5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:56.047689 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7a89db44-d18e-42f5-bbc5-1c68c4846ab5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:56.048114 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7a89db44-d18e-42f5-bbc5-1c68c4846ab5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:56.264500 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-7a89db44-d18e-42f5-bbc5-1c68c4846ab5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:56.273087 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-7a89db44-d18e-42f5-bbc5-1c68c4846ab5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:56.274823 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-7a89db44-d18e-42f5-bbc5-1c68c4846ab5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:56.276045 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-7a89db44-d18e-42f5-bbc5-1c68c4846ab5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1407 microversion: 2.20 time: 0.241655 Jul 04 10:12:56.276816 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 257/517] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:12:56 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:12:56.459326 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-6a41b1d8-1f5f-47dc-992a-14d9c3d4faaf req-5b238240-4510-40b6-9178-11ab913f6f35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a66cd362-4fe8-499f-850d-6755bd23c668", "tag": "4f41751d-4044-46c9-8fe9-0a9fdf5d5a79"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:12:56.469296 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-6a41b1d8-1f5f-47dc-992a-14d9c3d4faaf req-5b238240-4510-40b6-9178-11ab913f6f35 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:56.469810 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-6a41b1d8-1f5f-47dc-992a-14d9c3d4faaf req-5b238240-4510-40b6-9178-11ab913f6f35 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:56.484497 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-6a41b1d8-1f5f-47dc-992a-14d9c3d4faaf req-5b238240-4510-40b6-9178-11ab913f6f35 service nova] Creating event network-changed:4f41751d-4044-46c9-8fe9-0a9fdf5d5a79 for instance a66cd362-4fe8-499f-850d-6755bd23c668 on hv-cinder-84841 Jul 04 10:12:56.490940 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-6a41b1d8-1f5f-47dc-992a-14d9c3d4faaf req-5b238240-4510-40b6-9178-11ab913f6f35 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036211 Jul 04 10:12:56.491775 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 261/518] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:12:57.298785 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-70680116-170d-4311-b266-b103839ea548 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:57.299675 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-70680116-170d-4311-b266-b103839ea548 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:57.307504 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-70680116-170d-4311-b266-b103839ea548 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:57.307942 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-70680116-170d-4311-b266-b103839ea548 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:57.308688 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-70680116-170d-4311-b266-b103839ea548 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:57.309102 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-70680116-170d-4311-b266-b103839ea548 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:57.454912 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-70680116-170d-4311-b266-b103839ea548 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:57.465046 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-70680116-170d-4311-b266-b103839ea548 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:57.466925 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-70680116-170d-4311-b266-b103839ea548 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:57.468028 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-70680116-170d-4311-b266-b103839ea548 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1407 microversion: 2.20 time: 0.175777 Jul 04 10:12:57.468591 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 258/519] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:12:57 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:12:58.487056 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e102bf3b-e675-404e-bd2d-371e2a299935 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:58.487736 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-e102bf3b-e675-404e-bd2d-371e2a299935 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:58.494312 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e102bf3b-e675-404e-bd2d-371e2a299935 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:58.494749 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e102bf3b-e675-404e-bd2d-371e2a299935 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:58.495526 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e102bf3b-e675-404e-bd2d-371e2a299935 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:58.495950 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e102bf3b-e675-404e-bd2d-371e2a299935 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:58.627390 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-e102bf3b-e675-404e-bd2d-371e2a299935 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:58.636558 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-e102bf3b-e675-404e-bd2d-371e2a299935 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:58.638171 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-e102bf3b-e675-404e-bd2d-371e2a299935 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:58.639297 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-e102bf3b-e675-404e-bd2d-371e2a299935 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1407 microversion: 2.20 time: 0.157051 Jul 04 10:12:58.639888 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 262/520] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:12:58 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:12:59.661686 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-5e53f34e-3e80-4846-8588-2fef525da7bf tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:12:59.662716 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-5e53f34e-3e80-4846-8588-2fef525da7bf tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:12:59.673303 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5e53f34e-3e80-4846-8588-2fef525da7bf tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:59.674045 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5e53f34e-3e80-4846-8588-2fef525da7bf tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:59.675290 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5e53f34e-3e80-4846-8588-2fef525da7bf tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:12:59.675978 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5e53f34e-3e80-4846-8588-2fef525da7bf tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:12:59.814122 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-5e53f34e-3e80-4846-8588-2fef525da7bf tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:59.822387 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-5e53f34e-3e80-4846-8588-2fef525da7bf tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:59.823875 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-5e53f34e-3e80-4846-8588-2fef525da7bf tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:12:59.824970 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-5e53f34e-3e80-4846-8588-2fef525da7bf tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1407 microversion: 2.20 time: 0.169757 Jul 04 10:12:59.825525 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 259/521] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:12:59 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:13:00.335816 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-66e419f2-5581-4b0d-b57d-fb50047bdf03 req-b6690dce-cbf2-40c8-aa3c-3bd58a3f734b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a66cd362-4fe8-499f-850d-6755bd23c668", "name": "network-vif-plugged", "status": "completed", "tag": "4f41751d-4044-46c9-8fe9-0a9fdf5d5a79"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:13:00.345906 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-66e419f2-5581-4b0d-b57d-fb50047bdf03 req-b6690dce-cbf2-40c8-aa3c-3bd58a3f734b service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:00.346337 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-66e419f2-5581-4b0d-b57d-fb50047bdf03 req-b6690dce-cbf2-40c8-aa3c-3bd58a3f734b service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:00.359117 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-66e419f2-5581-4b0d-b57d-fb50047bdf03 req-b6690dce-cbf2-40c8-aa3c-3bd58a3f734b service nova] Creating event network-vif-plugged:4f41751d-4044-46c9-8fe9-0a9fdf5d5a79 for instance a66cd362-4fe8-499f-850d-6755bd23c668 on hv-cinder-84841 Jul 04 10:13:00.364054 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-66e419f2-5581-4b0d-b57d-fb50047bdf03 req-b6690dce-cbf2-40c8-aa3c-3bd58a3f734b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032050 Jul 04 10:13:00.364742 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 263/522] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:13:00.846394 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-3a08e114-406d-4000-88f9-072bc4f37a21 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:00.847217 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-3a08e114-406d-4000-88f9-072bc4f37a21 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:00.856492 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3a08e114-406d-4000-88f9-072bc4f37a21 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:00.857132 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3a08e114-406d-4000-88f9-072bc4f37a21 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:00.858261 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3a08e114-406d-4000-88f9-072bc4f37a21 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:00.858872 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3a08e114-406d-4000-88f9-072bc4f37a21 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:00.996115 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-3a08e114-406d-4000-88f9-072bc4f37a21 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:01.004423 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-3a08e114-406d-4000-88f9-072bc4f37a21 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:01.005938 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-3a08e114-406d-4000-88f9-072bc4f37a21 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:01.007032 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-3a08e114-406d-4000-88f9-072bc4f37a21 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1407 microversion: 2.20 time: 0.166771 Jul 04 10:13:01.007676 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 260/523] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:13:00 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:13:02.030077 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-ffe7cc01-51ef-4eae-8843-8e484801d406 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:02.031203 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-ffe7cc01-51ef-4eae-8843-8e484801d406 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:02.040997 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ffe7cc01-51ef-4eae-8843-8e484801d406 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:02.041438 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ffe7cc01-51ef-4eae-8843-8e484801d406 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:02.042232 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ffe7cc01-51ef-4eae-8843-8e484801d406 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:02.042660 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ffe7cc01-51ef-4eae-8843-8e484801d406 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:02.187360 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-ffe7cc01-51ef-4eae-8843-8e484801d406 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:02.198317 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-ffe7cc01-51ef-4eae-8843-8e484801d406 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:02.199791 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-ffe7cc01-51ef-4eae-8843-8e484801d406 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:02.200897 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-ffe7cc01-51ef-4eae-8843-8e484801d406 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1407 microversion: 2.20 time: 0.178811 Jul 04 10:13:02.201505 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 264/524] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:13:02 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:13:03.223870 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-09cd907a-64cc-4668-8576-d9855214bbb5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:03.224814 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-09cd907a-64cc-4668-8576-d9855214bbb5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:03.228049 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_api:SELECT=58 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:13:03.237664 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-09cd907a-64cc-4668-8576-d9855214bbb5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:03.238396 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-09cd907a-64cc-4668-8576-d9855214bbb5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:03.239682 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-09cd907a-64cc-4668-8576-d9855214bbb5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:03.240432 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-09cd907a-64cc-4668-8576-d9855214bbb5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:03.373401 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-09cd907a-64cc-4668-8576-d9855214bbb5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:03.381912 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-09cd907a-64cc-4668-8576-d9855214bbb5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:03.383399 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-09cd907a-64cc-4668-8576-d9855214bbb5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:03.384553 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-09cd907a-64cc-4668-8576-d9855214bbb5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1597 microversion: 2.20 time: 0.167432 Jul 04 10:13:03.385113 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 261/525] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:13:03 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1597 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:13:03.402551 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-da4e05c4-dd42-4a9d-a25b-08546b69d05b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:03.403112 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-da4e05c4-dd42-4a9d-a25b-08546b69d05b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:03.409745 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-da4e05c4-dd42-4a9d-a25b-08546b69d05b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:03.410182 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-da4e05c4-dd42-4a9d-a25b-08546b69d05b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:03.410944 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-da4e05c4-dd42-4a9d-a25b-08546b69d05b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:03.411374 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-da4e05c4-dd42-4a9d-a25b-08546b69d05b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:03.495508 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-da4e05c4-dd42-4a9d-a25b-08546b69d05b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.096897 Jul 04 10:13:03.496495 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 265/526] 10.222.0.79 () {60 vars in 1315 bytes} [Mon Jul 4 10:13:03 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 10:13:04.682600 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-db0ca61f-bdf1-47a9-a52c-d91f72b93623 req-2a88f9cd-60e7-4233-88c6-9e7f0c4e42ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a66cd362-4fe8-499f-850d-6755bd23c668", "tag": "4f41751d-4044-46c9-8fe9-0a9fdf5d5a79"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:13:04.686182 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell0:SELECT=2 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:13:04.691755 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-db0ca61f-bdf1-47a9-a52c-d91f72b93623 req-2a88f9cd-60e7-4233-88c6-9e7f0c4e42ff service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:04.692167 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-db0ca61f-bdf1-47a9-a52c-d91f72b93623 req-2a88f9cd-60e7-4233-88c6-9e7f0c4e42ff service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:04.704184 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-db0ca61f-bdf1-47a9-a52c-d91f72b93623 req-2a88f9cd-60e7-4233-88c6-9e7f0c4e42ff service nova] Creating event network-changed:4f41751d-4044-46c9-8fe9-0a9fdf5d5a79 for instance a66cd362-4fe8-499f-850d-6755bd23c668 on hv-cinder-84841 Jul 04 10:13:04.709412 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-db0ca61f-bdf1-47a9-a52c-d91f72b93623 req-2a88f9cd-60e7-4233-88c6-9e7f0c4e42ff service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030664 Jul 04 10:13:04.710389 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 262/527] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:13:17.447688 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:13:17.448556 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=10 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:13:17.450503 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:13:17.451178 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:13:17.456002 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-763fd389-a8f0-448f-bb38-17c305f70b80 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:17.457168 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-763fd389-a8f0-448f-bb38-17c305f70b80 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:17.466699 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-763fd389-a8f0-448f-bb38-17c305f70b80 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:17.467188 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-763fd389-a8f0-448f-bb38-17c305f70b80 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:17.468191 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-763fd389-a8f0-448f-bb38-17c305f70b80 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:17.468710 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-763fd389-a8f0-448f-bb38-17c305f70b80 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:17.500011 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-763fd389-a8f0-448f-bb38-17c305f70b80 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053088 Jul 04 10:13:17.500562 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 266/528] 10.222.0.79 () {58 vars in 1301 bytes} [Mon Jul 4 10:13:17 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 04 10:13:17.562190 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-3d77bc98-63ae-4481-89d1-112bf1b283e9 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:17.562756 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-3d77bc98-63ae-4481-89d1-112bf1b283e9 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:17.565178 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_api:SELECT=3 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:13:17.565812 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell1:SELECT=51 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:13:17.572832 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3d77bc98-63ae-4481-89d1-112bf1b283e9 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:17.573266 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3d77bc98-63ae-4481-89d1-112bf1b283e9 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:17.574037 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3d77bc98-63ae-4481-89d1-112bf1b283e9 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:17.574463 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3d77bc98-63ae-4481-89d1-112bf1b283e9 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:17.599258 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-3d77bc98-63ae-4481-89d1-112bf1b283e9 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Going to try to terminate instance {{(pid=117866) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 10:13:17.680088 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-3d77bc98-63ae-4481-89d1-112bf1b283e9 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 204 len: 0 microversion: 2.1 time: 0.121992 Jul 04 10:13:17.680762 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 263/529] 10.222.0.79 () {58 vars in 1238 bytes} [Mon Jul 4 10:13:17 2022] DELETE /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 10:13:17.689348 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-9697ea3f-612e-48ae-90ec-765dee8cf7c7 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:17.689983 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-9697ea3f-612e-48ae-90ec-765dee8cf7c7 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:17.696055 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9697ea3f-612e-48ae-90ec-765dee8cf7c7 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:17.696505 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9697ea3f-612e-48ae-90ec-765dee8cf7c7 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:17.697260 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9697ea3f-612e-48ae-90ec-765dee8cf7c7 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:17.697717 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9697ea3f-612e-48ae-90ec-765dee8cf7c7 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:17.833954 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-9697ea3f-612e-48ae-90ec-765dee8cf7c7 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:17.842257 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-9697ea3f-612e-48ae-90ec-765dee8cf7c7 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1673 microversion: 2.1 time: 0.156817 Jul 04 10:13:17.842827 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 267/530] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:17 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:18.861382 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-f52a3ddb-a6d7-4345-a4f9-c30a34e4e3ae tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:18.862296 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-f52a3ddb-a6d7-4345-a4f9-c30a34e4e3ae tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:18.868859 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f52a3ddb-a6d7-4345-a4f9-c30a34e4e3ae tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:18.869302 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f52a3ddb-a6d7-4345-a4f9-c30a34e4e3ae tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:18.870088 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f52a3ddb-a6d7-4345-a4f9-c30a34e4e3ae tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:18.870515 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f52a3ddb-a6d7-4345-a4f9-c30a34e4e3ae tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:19.006657 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-f52a3ddb-a6d7-4345-a4f9-c30a34e4e3ae tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:19.014245 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-f52a3ddb-a6d7-4345-a4f9-c30a34e4e3ae tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1673 microversion: 2.1 time: 0.157347 Jul 04 10:13:19.014804 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 264/531] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:18 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:20.031918 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-65ac879c-c504-4acd-b7d3-f4f0852cc1a3 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:20.032488 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-65ac879c-c504-4acd-b7d3-f4f0852cc1a3 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:20.039766 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-65ac879c-c504-4acd-b7d3-f4f0852cc1a3 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:20.040110 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-65ac879c-c504-4acd-b7d3-f4f0852cc1a3 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:20.040874 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-65ac879c-c504-4acd-b7d3-f4f0852cc1a3 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:20.041305 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-65ac879c-c504-4acd-b7d3-f4f0852cc1a3 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:20.241925 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-65ac879c-c504-4acd-b7d3-f4f0852cc1a3 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:20.251011 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-65ac879c-c504-4acd-b7d3-f4f0852cc1a3 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1673 microversion: 2.1 time: 0.223334 Jul 04 10:13:20.251625 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 268/532] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:20 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1673 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:20.918839 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-2ae0f7af-7118-4f84-bf71-433a67bea8c5 req-686b8afe-ea89-4d4b-85b0-7edaad8a5739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a842f878-2275-4988-8e51-b3b7276678e7", "name": "network-vif-deleted", "tag": "2172e408-c0ad-454d-89dc-0a5bd85b15cb"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:13:20.930544 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-2ae0f7af-7118-4f84-bf71-433a67bea8c5 req-686b8afe-ea89-4d4b-85b0-7edaad8a5739 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:20.931338 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-2ae0f7af-7118-4f84-bf71-433a67bea8c5 req-686b8afe-ea89-4d4b-85b0-7edaad8a5739 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:20.947737 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-2ae0f7af-7118-4f84-bf71-433a67bea8c5 req-686b8afe-ea89-4d4b-85b0-7edaad8a5739 service nova] Creating event network-vif-deleted:2172e408-c0ad-454d-89dc-0a5bd85b15cb for instance a842f878-2275-4988-8e51-b3b7276678e7 on hv-cinder-84841 Jul 04 10:13:20.957322 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-2ae0f7af-7118-4f84-bf71-433a67bea8c5 req-686b8afe-ea89-4d4b-85b0-7edaad8a5739 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041480 Jul 04 10:13:20.958935 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 265/533] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:13:21.270133 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-fae508ae-1468-401e-94d3-9e43215a8386 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:21.270735 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-fae508ae-1468-401e-94d3-9e43215a8386 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:21.277825 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fae508ae-1468-401e-94d3-9e43215a8386 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:21.278275 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fae508ae-1468-401e-94d3-9e43215a8386 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:21.279048 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fae508ae-1468-401e-94d3-9e43215a8386 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:21.279481 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fae508ae-1468-401e-94d3-9e43215a8386 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:21.315284 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fae508ae-1468-401e-94d3-9e43215a8386 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:21.315780 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fae508ae-1468-401e-94d3-9e43215a8386 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:21.316230 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.objects.instance [None req-fae508ae-1468-401e-94d3-9e43215a8386 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lazy-loading 'fault' on Instance uuid a842f878-2275-4988-8e51-b3b7276678e7 {{(pid=117865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 10:13:21.369553 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-fae508ae-1468-401e-94d3-9e43215a8386 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:21.378528 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-fae508ae-1468-401e-94d3-9e43215a8386 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 200 len: 1327 microversion: 2.1 time: 0.113618 Jul 04 10:13:21.379266 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 269/534] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:21 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 1327 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:22.403060 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-869e0e10-d622-4d21-8b9a-349da8559c2e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:22.404106 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-869e0e10-d622-4d21-8b9a-349da8559c2e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:22.413445 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-869e0e10-d622-4d21-8b9a-349da8559c2e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:22.413924 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-869e0e10-d622-4d21-8b9a-349da8559c2e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:22.414689 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-869e0e10-d622-4d21-8b9a-349da8559c2e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:22.415118 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-869e0e10-d622-4d21-8b9a-349da8559c2e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:22.428498 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.wsgi [None req-869e0e10-d622-4d21-8b9a-349da8559c2e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] HTTP exception thrown: Instance a842f878-2275-4988-8e51-b3b7276678e7 could not be found. Jul 04 10:13:22.430137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-869e0e10-d622-4d21-8b9a-349da8559c2e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Request method failure captured: Jul 04 10:13:22.430137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: request: GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 HTTP/1.1 Jul 04 10:13:22.430137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept: application/json Jul 04 10:13:22.430137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept-Encoding: identity Jul 04 10:13:22.430137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Connection: close Jul 04 10:13:22.430137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Length: 0 Jul 04 10:13:22.430137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Type: application/json Jul 04 10:13:22.430137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Host: 10.222.0.79 Jul 04 10:13:22.430137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Openstack-System-Scope: None Jul 04 10:13:22.430137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: User-Agent: python-urllib3/1.26.9 Jul 04 10:13:22.430137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Auth-Token: gAAAAABiwrwqqpSzXCz6TI7i3v3Q0Ikv6eP5G-aFeEx1FMOX4uF8_xFSEGq1OvsjmphPPgrV_LZ7ApTiSGpB_p8ebTXPQypjNBbmCiLNfN6Vw7ly4_fGoJrpUrTq3Bgn-HxcRgFMGj02UI8_qzoahUfhl7siMEcN-dAFCb5QyOQ3C5VA-l3wHp4 Jul 04 10:13:22.430137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Id: None Jul 04 10:13:22.430137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Name: None Jul 04 10:13:22.430137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Identity-Status: Confirmed Jul 04 10:13:22.430137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Is-Admin-Project: True Jul 04 10:13:22.430137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Id: default Jul 04 10:13:22.430137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Name: Default Jul 04 10:13:22.430137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Id: 2f559cbed35f4fbb8fe71906696733e7 Jul 04 10:13:22.430137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Name: tempest-AttachVolumeTestJSON-439716941 Jul 04 10:13:22.430137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Role: reader,member Jul 04 10:13:22.430137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Roles: reader,member Jul 04 10:13:22.431587 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2f559cbed35f4fbb8fe71906696733e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2f559cbed35f4fbb8fe71906696733e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2f559cbed35f4fbb8fe71906696733e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2f559cbed35f4fbb8fe71906696733e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:13:22.431587 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant: tempest-AttachVolumeTestJSON-439716941 Jul 04 10:13:22.431587 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Id: 2f559cbed35f4fbb8fe71906696733e7 Jul 04 10:13:22.431587 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Name: tempest-AttachVolumeTestJSON-439716941 Jul 04 10:13:22.431587 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User: tempest-AttachVolumeTestJSON-439716941-project Jul 04 10:13:22.431587 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Id: default Jul 04 10:13:22.431587 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Name: Default Jul 04 10:13:22.431587 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Id: dfba262d439a4253bf1c2c0f114d0cdc Jul 04 10:13:22.431587 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Name: tempest-AttachVolumeTestJSON-439716941-project Jul 04 10:13:22.431587 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: method: > Jul 04 10:13:22.431587 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: exception: Instance a842f878-2275-4988-8e51-b3b7276678e7 could not be found. Jul 04 10:13:22.431587 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: action_args: {'id': 'a842f878-2275-4988-8e51-b3b7276678e7'} Jul 04 10:13:22.432444 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:13:22.432444 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:13:22.432444 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:13:22.432444 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:13:22.432444 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:13:22.432444 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:13:22.432444 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:13:22.432444 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:13:22.432444 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:13:22.432444 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:13:22.432444 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a842f878-2275-4988-8e51-b3b7276678e7 could not be found. Jul 04 10:13:22.432444 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:13:22.432444 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:13:22.432444 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:13:22.432444 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:13:22.432444 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:13:22.432444 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:13:22.432444 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:13:22.432444 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:13:22.432444 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:13:22.433989 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:13:22.433989 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 10:13:22.433989 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 10:13:22.433989 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:13:22.433989 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:13:22.433989 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:13:22.433989 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:13:22.433989 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a842f878-2275-4988-8e51-b3b7276678e7 could not be found. Jul 04 10:13:22.433989 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:13:22.433989 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:13:22.433989 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:13:22.433989 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:13:22.433989 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:13:22.433989 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:13:22.433989 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:13:22.433989 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:13:22.433989 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a842f878-2275-4988-8e51-b3b7276678e7 could not be found. Jul 04 10:13:22.433989 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:13:22.435577 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-869e0e10-d622-4d21-8b9a-349da8559c2e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Returning 404 to user: Instance a842f878-2275-4988-8e51-b3b7276678e7 could not be found. {{(pid=117866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:13:22.435577 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-869e0e10-d622-4d21-8b9a-349da8559c2e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 404 len: 111 microversion: 2.1 time: 0.036107 Jul 04 10:13:22.435577 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 266/535] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:22 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:13:22.440452 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f193d5d4-d695-47f2-b2d9-e66e8aa3e8d7 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '.version_select at 0x7f2808099c10>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:22.459814 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f193d5d4-d695-47f2-b2d9-e66e8aa3e8d7 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1594538124" status: 202 len: 0 microversion: 2.1 time: 0.023103 Jul 04 10:13:22.460404 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 270/536] 10.222.0.79 () {58 vars in 1220 bytes} [Mon Jul 4 10:13:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1594538124 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 10:13:22.667080 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-58b98125-c638-4d39-a0d3-5a92c847846c tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:22.667603 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-58b98125-c638-4d39-a0d3-5a92c847846c tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a936822b-ef8c-42ad-9510-194756830a00] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:22.673798 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-58b98125-c638-4d39-a0d3-5a92c847846c tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:22.674317 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-58b98125-c638-4d39-a0d3-5a92c847846c tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:22.675147 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-58b98125-c638-4d39-a0d3-5a92c847846c tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:22.675671 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-58b98125-c638-4d39-a0d3-5a92c847846c tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:22.699060 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-58b98125-c638-4d39-a0d3-5a92c847846c tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00/ips" status: 200 len: 150 microversion: 2.1 time: 0.035969 Jul 04 10:13:22.699668 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 267/537] 10.222.0.79 () {58 vars in 1247 bytes} [Mon Jul 4 10:13:22 2022] GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:13:23.115874 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-9aeca87a-e864-48d5-b2c8-07db3b25887b tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Action: 'create', calling method: .version_select at 0x7f2802f98310>, body: {"keypair": {"name": "tempest-keypair-1509875066", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvhknMLIE3nVPHt4GnCFiTSckx1Q2q0lpW/r9B5DEOailekyiYc7HpcDsPAq/O0HzTvMcsf5U4OZDaSj67yeBKAW+qrNeqyUmMC0DJpoCvGafvpiA1vWNSZLvot92JB6Q=="}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:13:23.131792 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-9aeca87a-e864-48d5-b2c8-07db3b25887b tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Getting quotas for project 2f559cbed35f4fbb8fe71906696733e7. Resources: {'key_pairs'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 10:13:23.136609 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-9aeca87a-e864-48d5-b2c8-07db3b25887b tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Getting quotas for user dfba262d439a4253bf1c2c0f114d0cdc and project 2f559cbed35f4fbb8fe71906696733e7. Resources: {'key_pairs'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 10:13:23.161364 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-9aeca87a-e864-48d5-b2c8-07db3b25887b tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049885 Jul 04 10:13:23.162026 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 271/538] 10.222.0.79 () {60 vars in 1158 bytes} [Mon Jul 4 10:13:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:13:24.040616 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-0243b8d9-0231-4f7e-b4d3-62b427ac70c1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ccbe085-6ec9-46ac-b420-58ecb001a687"}} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:13:24.041712 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-0243b8d9-0231-4f7e-b4d3-62b427ac70c1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a936822b-ef8c-42ad-9510-194756830a00] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:24.047829 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0243b8d9-0231-4f7e-b4d3-62b427ac70c1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:24.048274 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0243b8d9-0231-4f7e-b4d3-62b427ac70c1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:24.049037 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0243b8d9-0231-4f7e-b4d3-62b427ac70c1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:24.049464 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0243b8d9-0231-4f7e-b4d3-62b427ac70c1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:24.313224 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-0243b8d9-0231-4f7e-b4d3-62b427ac70c1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "POST /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276917 Jul 04 10:13:24.313869 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 268/539] 10.222.0.79 () {60 vars in 1322 bytes} [Mon Jul 4 10:13:24 2022] POST /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:13:24.517025 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2414b161-de39-4638-86e8-a87fdcf9d6ac tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-286207261", "imageRef": "80bd29b0-b77c-4611-be31-69ca559a2d2a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "28afbc1c-7fbf-4c17-a5be-8814771902ab"}], "security_groups": [{"name": "tempest-securitygroup--899117126"}], "key_name": "tempest-keypair-1509875066", "user_data": "}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:13:24.626325 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.network.neutron [None req-2414b161-de39-4638-86e8-a87fdcf9d6ac tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] validate_networks() for [('28afbc1c-7fbf-4c17-a5be-8814771902ab', None, None, None, None, None)] {{(pid=117865) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 10:13:25.042072 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-2414b161-de39-4638-86e8-a87fdcf9d6ac tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Flavor limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 10:13:25.042630 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-2414b161-de39-4638-86e8-a87fdcf9d6ac tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Image limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 10:13:25.043296 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-2414b161-de39-4638-86e8-a87fdcf9d6ac tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Flavor pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 10:13:25.043766 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-2414b161-de39-4638-86e8-a87fdcf9d6ac tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Image pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 10:13:25.044302 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-2414b161-de39-4638-86e8-a87fdcf9d6ac tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 10:13:25.056957 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2414b161-de39-4638-86e8-a87fdcf9d6ac tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:25.057406 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2414b161-de39-4638-86e8-a87fdcf9d6ac tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:25.058221 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2414b161-de39-4638-86e8-a87fdcf9d6ac tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:25.058644 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2414b161-de39-4638-86e8-a87fdcf9d6ac tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:25.075750 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-2414b161-de39-4638-86e8-a87fdcf9d6ac tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Getting quotas for project 2f559cbed35f4fbb8fe71906696733e7. Resources: {'cores', 'ram', 'instances'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 10:13:25.079971 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-2414b161-de39-4638-86e8-a87fdcf9d6ac tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Getting quotas for user dfba262d439a4253bf1c2c0f114d0cdc and project 2f559cbed35f4fbb8fe71906696733e7. Resources: {'cores', 'ram', 'instances'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 10:13:25.092082 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-2414b161-de39-4638-86e8-a87fdcf9d6ac tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Going to run 1 instances... {{(pid=117865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 10:13:25.094341 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-2414b161-de39-4638-86e8-a87fdcf9d6ac tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80bd29b0-b77c-4611-be31-69ca559a2d2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 10:13:25.146610 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-2414b161-de39-4638-86e8-a87fdcf9d6ac tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.634373 Jul 04 10:13:25.147697 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 272/540] 10.222.0.79 () {60 vars in 1146 bytes} [Mon Jul 4 10:13:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 10:13:25.161747 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-5249276c-4b50-4af4-9b2c-c30c9aef92eb tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:25.163565 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-5249276c-4b50-4af4-9b2c-c30c9aef92eb tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:25.223097 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-5249276c-4b50-4af4-9b2c-c30c9aef92eb tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:25.230366 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-5249276c-4b50-4af4-9b2c-c30c9aef92eb tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90" status: 200 len: 1237 microversion: 2.1 time: 0.073538 Jul 04 10:13:25.231090 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 269/541] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:25 2022] GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90 => generated 1237 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:26.250336 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-4eafd05c-52cc-4467-bcf8-32a18b8360dc tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:26.251024 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-4eafd05c-52cc-4467-bcf8-32a18b8360dc tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:26.259390 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4eafd05c-52cc-4467-bcf8-32a18b8360dc tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:26.259830 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4eafd05c-52cc-4467-bcf8-32a18b8360dc tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:26.260582 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4eafd05c-52cc-4467-bcf8-32a18b8360dc tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:26.261008 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4eafd05c-52cc-4467-bcf8-32a18b8360dc tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:26.472738 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-4eafd05c-52cc-4467-bcf8-32a18b8360dc tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:26.480380 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-4eafd05c-52cc-4467-bcf8-32a18b8360dc tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90" status: 200 len: 1289 microversion: 2.1 time: 0.235863 Jul 04 10:13:26.480946 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 273/542] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:26 2022] GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90 => generated 1289 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:27.498194 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-13ce31b6-a61f-41ad-bbbf-6a87361f7ae7 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:27.498806 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-13ce31b6-a61f-41ad-bbbf-6a87361f7ae7 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:27.507110 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-13ce31b6-a61f-41ad-bbbf-6a87361f7ae7 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:27.507425 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-13ce31b6-a61f-41ad-bbbf-6a87361f7ae7 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:27.508760 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-13ce31b6-a61f-41ad-bbbf-6a87361f7ae7 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:27.509196 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-13ce31b6-a61f-41ad-bbbf-6a87361f7ae7 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:27.763776 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-13ce31b6-a61f-41ad-bbbf-6a87361f7ae7 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:27.771351 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-13ce31b6-a61f-41ad-bbbf-6a87361f7ae7 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90" status: 200 len: 1362 microversion: 2.1 time: 0.277127 Jul 04 10:13:27.771887 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 270/543] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:27 2022] GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90 => generated 1362 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:27.894354 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-e4aff28a-9f3e-4e63-b683-dfa286dbb32e req-3043e3cc-99c1-4957-81da-43ee44cf24e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "383b09a2-bd4d-450c-9be6-413d465e3f90", "tag": "f3ced8cf-b87b-4d22-b190-3b0019183ff9"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:13:27.914215 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-e4aff28a-9f3e-4e63-b683-dfa286dbb32e req-3043e3cc-99c1-4957-81da-43ee44cf24e1 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:27.915166 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-e4aff28a-9f3e-4e63-b683-dfa286dbb32e req-3043e3cc-99c1-4957-81da-43ee44cf24e1 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:27.930224 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-e4aff28a-9f3e-4e63-b683-dfa286dbb32e req-3043e3cc-99c1-4957-81da-43ee44cf24e1 service nova] Creating event network-changed:f3ced8cf-b87b-4d22-b190-3b0019183ff9 for instance 383b09a2-bd4d-450c-9be6-413d465e3f90 on hv-cinder-84841 Jul 04 10:13:27.936048 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-e4aff28a-9f3e-4e63-b683-dfa286dbb32e req-3043e3cc-99c1-4957-81da-43ee44cf24e1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050554 Jul 04 10:13:27.936623 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 274/544] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:13:28.793654 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-46fea03a-3ee1-4675-abcb-794a7ca2a821 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:28.794698 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-46fea03a-3ee1-4675-abcb-794a7ca2a821 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:28.805507 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-46fea03a-3ee1-4675-abcb-794a7ca2a821 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:28.805992 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-46fea03a-3ee1-4675-abcb-794a7ca2a821 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:28.806759 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-46fea03a-3ee1-4675-abcb-794a7ca2a821 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:28.807161 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-46fea03a-3ee1-4675-abcb-794a7ca2a821 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:28.943893 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-46fea03a-3ee1-4675-abcb-794a7ca2a821 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:28.951937 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-46fea03a-3ee1-4675-abcb-794a7ca2a821 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90" status: 200 len: 1362 microversion: 2.1 time: 0.164912 Jul 04 10:13:28.952733 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 271/545] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:28 2022] GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:29.635843 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f77afeba-d0e0-4932-9320-0bbdd7e172a8 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:29.636406 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f77afeba-d0e0-4932-9320-0bbdd7e172a8 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:29.643809 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f77afeba-d0e0-4932-9320-0bbdd7e172a8 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:29.644539 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f77afeba-d0e0-4932-9320-0bbdd7e172a8 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:29.645412 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f77afeba-d0e0-4932-9320-0bbdd7e172a8 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:29.645967 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f77afeba-d0e0-4932-9320-0bbdd7e172a8 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:29.735233 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.objects.instance [None req-f77afeba-d0e0-4932-9320-0bbdd7e172a8 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lazy-loading 'services' on Instance uuid cae1c9c4-3ee8-4aae-8911-21df5f3c37df {{(pid=117865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 10:13:29.813691 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f77afeba-d0e0-4932-9320-0bbdd7e172a8 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "DELETE /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df/os-volume_attachments/e47af670-35fc-4e8b-a711-288429e75bb4" status: 202 len: 0 microversion: 2.1 time: 0.182548 Jul 04 10:13:29.814628 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 275/546] 10.222.0.79 () {58 vars in 1415 bytes} [Mon Jul 4 10:13:29 2022] DELETE /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df/os-volume_attachments/e47af670-35fc-4e8b-a711-288429e75bb4 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 10:13:29.824747 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-5b430290-3e96-4b5e-ba4f-4c3884da4718 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:29.825792 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-5b430290-3e96-4b5e-ba4f-4c3884da4718 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:29.832808 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5b430290-3e96-4b5e-ba4f-4c3884da4718 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:29.833434 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5b430290-3e96-4b5e-ba4f-4c3884da4718 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:29.834501 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5b430290-3e96-4b5e-ba4f-4c3884da4718 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:29.834940 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5b430290-3e96-4b5e-ba4f-4c3884da4718 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:29.869432 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-5b430290-3e96-4b5e-ba4f-4c3884da4718 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050095 Jul 04 10:13:29.870034 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 272/547] 10.222.0.79 () {58 vars in 1301 bytes} [Mon Jul 4 10:13:29 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:13:29.971028 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f5fc16da-6efc-4645-835a-a47c243cb7e0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:29.971743 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f5fc16da-6efc-4645-835a-a47c243cb7e0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:29.979590 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f5fc16da-6efc-4645-835a-a47c243cb7e0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:29.980034 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f5fc16da-6efc-4645-835a-a47c243cb7e0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:29.980795 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f5fc16da-6efc-4645-835a-a47c243cb7e0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:29.981226 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f5fc16da-6efc-4645-835a-a47c243cb7e0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:30.178564 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-f5fc16da-6efc-4645-835a-a47c243cb7e0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:30.186604 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f5fc16da-6efc-4645-835a-a47c243cb7e0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90" status: 200 len: 1362 microversion: 2.1 time: 0.221055 Jul 04 10:13:30.187211 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 276/548] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:29 2022] GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90 => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:30.881422 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-e24d9d29-45b6-4e76-94c3-25b8c572ad03 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:30.882316 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-e24d9d29-45b6-4e76-94c3-25b8c572ad03 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:30.889373 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e24d9d29-45b6-4e76-94c3-25b8c572ad03 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:30.889865 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e24d9d29-45b6-4e76-94c3-25b8c572ad03 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:30.890638 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e24d9d29-45b6-4e76-94c3-25b8c572ad03 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:30.891123 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e24d9d29-45b6-4e76-94c3-25b8c572ad03 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:30.921488 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-e24d9d29-45b6-4e76-94c3-25b8c572ad03 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044763 Jul 04 10:13:30.922143 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 273/549] 10.222.0.79 () {58 vars in 1301 bytes} [Mon Jul 4 10:13:30 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:13:31.203864 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-1f2759b6-8297-42ea-bf6a-339d0a7fd61c tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:31.204448 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-1f2759b6-8297-42ea-bf6a-339d0a7fd61c tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:31.211629 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1f2759b6-8297-42ea-bf6a-339d0a7fd61c tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:31.212062 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1f2759b6-8297-42ea-bf6a-339d0a7fd61c tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:31.212841 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1f2759b6-8297-42ea-bf6a-339d0a7fd61c tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:31.213557 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1f2759b6-8297-42ea-bf6a-339d0a7fd61c tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:31.365314 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-1f2759b6-8297-42ea-bf6a-339d0a7fd61c tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:31.376612 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-1f2759b6-8297-42ea-bf6a-339d0a7fd61c tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90" status: 200 len: 1362 microversion: 2.1 time: 0.176419 Jul 04 10:13:31.377397 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 277/550] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:31 2022] GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:31.876613 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-6babee77-aa00-4c79-99d4-f9320e8ad220 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ccbe085-6ec9-46ac-b420-58ecb001a687"}} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:13:31.877708 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-6babee77-aa00-4c79-99d4-f9320e8ad220 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a936822b-ef8c-42ad-9510-194756830a00] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:31.884661 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-6babee77-aa00-4c79-99d4-f9320e8ad220 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:31.885237 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-6babee77-aa00-4c79-99d4-f9320e8ad220 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:31.885969 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-6babee77-aa00-4c79-99d4-f9320e8ad220 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:31.886403 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-6babee77-aa00-4c79-99d4-f9320e8ad220 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:31.932607 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-4ad95a71-cf33-4728-b0e5-5660b55966e9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:31.933849 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-4ad95a71-cf33-4728-b0e5-5660b55966e9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:31.941153 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4ad95a71-cf33-4728-b0e5-5660b55966e9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:31.941794 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4ad95a71-cf33-4728-b0e5-5660b55966e9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:31.942556 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4ad95a71-cf33-4728-b0e5-5660b55966e9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:31.943013 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4ad95a71-cf33-4728-b0e5-5660b55966e9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:31.971524 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.wsgi [None req-6babee77-aa00-4c79-99d4-f9320e8ad220 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] HTTP exception thrown: Invalid volume: volume 4ccbe085-6ec9-46ac-b420-58ecb001a687 is already attached to instances: a936822b-ef8c-42ad-9510-194756830a00 Jul 04 10:13:31.973220 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-6babee77-aa00-4c79-99d4-f9320e8ad220 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Request method failure captured: Jul 04 10:13:31.973220 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: request: POST /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00/os-volume_attachments HTTP/1.1 Jul 04 10:13:31.973220 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept: application/json Jul 04 10:13:31.973220 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept-Encoding: identity Jul 04 10:13:31.973220 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Connection: close Jul 04 10:13:31.973220 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Length: 74 Jul 04 10:13:31.973220 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Type: application/json Jul 04 10:13:31.973220 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Host: 10.222.0.79 Jul 04 10:13:31.973220 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Openstack-System-Scope: None Jul 04 10:13:31.973220 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: User-Agent: python-urllib3/1.26.9 Jul 04 10:13:31.973220 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Auth-Token: gAAAAABiwrwvD9yiGE4pStEGBF2Ys-pryu1tx1k2auUnE0PRvpPvnRtEQEaHpqZQ8egutal5ICM4nB9U9UkZUlVAaFmujyok7-zJ_4u8OoD2UCOlqV-Oyun1vIdrrzMPcAwbXsLkKDns-0TZYcaWBDNIYObNG0qh5NpdFBBI5iioapUAgXk4vDM Jul 04 10:13:31.973220 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Id: None Jul 04 10:13:31.973220 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Name: None Jul 04 10:13:31.973220 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Identity-Status: Confirmed Jul 04 10:13:31.973220 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Is-Admin-Project: True Jul 04 10:13:31.973220 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Id: default Jul 04 10:13:31.973220 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Name: Default Jul 04 10:13:31.973220 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Id: a57f93d66f534107a228d908afa64890 Jul 04 10:13:31.973220 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Name: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:13:31.973220 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Role: reader,member Jul 04 10:13:31.973220 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Roles: reader,member Jul 04 10:13:31.979089 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a57f93d66f534107a228d908afa64890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a57f93d66f534107a228d908afa64890"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a57f93d66f534107a228d908afa64890"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a57f93d66f534107a228d908afa64890"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:13:31.979089 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:13:31.979089 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Id: a57f93d66f534107a228d908afa64890 Jul 04 10:13:31.979089 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:13:31.979089 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User: tempest-AttachVolumeNegativeTest-223944498-project Jul 04 10:13:31.979089 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Id: default Jul 04 10:13:31.979089 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Name: Default Jul 04 10:13:31.979089 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Id: 88d2351fc3b74ef5a530fded1be6b997 Jul 04 10:13:31.979089 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Name: tempest-AttachVolumeNegativeTest-223944498-project Jul 04 10:13:31.979089 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Jul 04 10:13:31.979089 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {"volumeAttachment": {"volumeId": "4ccbe085-6ec9-46ac-b420-58ecb001a687"}} Jul 04 10:13:31.979089 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: method: > Jul 04 10:13:31.979813 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: exception: Invalid volume: volume 4ccbe085-6ec9-46ac-b420-58ecb001a687 is already attached to instances: a936822b-ef8c-42ad-9510-194756830a00 Jul 04 10:13:31.979813 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: action_args: {'server_id': 'a936822b-ef8c-42ad-9510-194756830a00', 'body': {'volumeAttachment': {'volumeId': '4ccbe085-6ec9-46ac-b420-58ecb001a687'}}} Jul 04 10:13:31.979813 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:13:31.979813 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:13:31.979813 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 04 10:13:31.979813 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 04 10:13:31.979813 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 04 10:13:31.979813 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 04 10:13:31.979813 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 04 10:13:31.979813 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 04 10:13:31.979813 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 04 10:13:31.979813 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 04 10:13:31.979813 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 04 10:13:31.979813 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 04 10:13:31.979813 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4ccbe085-6ec9-46ac-b420-58ecb001a687 is already attached to instances: a936822b-ef8c-42ad-9510-194756830a00 Jul 04 10:13:31.979813 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:13:31.979813 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:13:31.979813 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:13:31.979813 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:13:31.980889 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:13:31.980889 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:13:31.980889 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:13:31.980889 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:13:31.980889 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:13:31.980889 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:13:31.980889 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 10:13:31.980889 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 10:13:31.980889 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 10:13:31.980889 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 10:13:31.980889 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 10:13:31.980889 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 10:13:31.980889 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 04 10:13:31.980889 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 04 10:13:31.980889 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4ccbe085-6ec9-46ac-b420-58ecb001a687 is already attached to instances: a936822b-ef8c-42ad-9510-194756830a00 Jul 04 10:13:31.980889 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:13:31.980889 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:13:31.980889 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:13:31.980889 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:13:31.980889 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:13:31.982180 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:13:31.982180 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:13:31.982180 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:13:31.982180 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4ccbe085-6ec9-46ac-b420-58ecb001a687 is already attached to instances: a936822b-ef8c-42ad-9510-194756830a00 Jul 04 10:13:31.982180 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:13:31.982600 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-4ad95a71-cf33-4728-b0e5-5660b55966e9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044842 Jul 04 10:13:31.982682 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-6babee77-aa00-4c79-99d4-f9320e8ad220 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Returning 400 to user: Invalid volume: volume 4ccbe085-6ec9-46ac-b420-58ecb001a687 is already attached to instances: a936822b-ef8c-42ad-9510-194756830a00 {{(pid=117866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:13:31.982765 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 278/551] 10.222.0.79 () {58 vars in 1301 bytes} [Mon Jul 4 10:13:31 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 10:13:31.982845 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-6babee77-aa00-4c79-99d4-f9320e8ad220 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "POST /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102110 Jul 04 10:13:31.982845 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 274/552] 10.222.0.79 () {60 vars in 1322 bytes} [Mon Jul 4 10:13:31 2022] POST /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 04 10:13:32.035421 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-151cdcc7-2350-4263-8465-ec661e8dfa1d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:32.035912 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-151cdcc7-2350-4263-8465-ec661e8dfa1d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a936822b-ef8c-42ad-9510-194756830a00] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:32.042870 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-151cdcc7-2350-4263-8465-ec661e8dfa1d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:32.043309 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-151cdcc7-2350-4263-8465-ec661e8dfa1d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:32.044066 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-151cdcc7-2350-4263-8465-ec661e8dfa1d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:32.044490 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-151cdcc7-2350-4263-8465-ec661e8dfa1d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:32.045890 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-a742f368-67d5-475f-ad2a-5834b0ed0423 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:32.046380 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-a742f368-67d5-475f-ad2a-5834b0ed0423 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:32.052512 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a742f368-67d5-475f-ad2a-5834b0ed0423 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:32.052960 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a742f368-67d5-475f-ad2a-5834b0ed0423 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:32.053743 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a742f368-67d5-475f-ad2a-5834b0ed0423 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:32.054175 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a742f368-67d5-475f-ad2a-5834b0ed0423 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:32.080561 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-a742f368-67d5-475f-ad2a-5834b0ed0423 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Going to try to terminate instance {{(pid=117866) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 10:13:32.127673 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.objects.instance [None req-151cdcc7-2350-4263-8465-ec661e8dfa1d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lazy-loading 'services' on Instance uuid a936822b-ef8c-42ad-9510-194756830a00 {{(pid=117865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 10:13:32.165748 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-a742f368-67d5-475f-ad2a-5834b0ed0423 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "DELETE /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 204 len: 0 microversion: 2.1 time: 0.123053 Jul 04 10:13:32.166923 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 275/553] 10.222.0.79 () {58 vars in 1238 bytes} [Mon Jul 4 10:13:32 2022] DELETE /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 10:13:32.176755 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-d54bd2f1-8a91-4aaa-9920-3a1a6a56839b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:32.177452 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-d54bd2f1-8a91-4aaa-9920-3a1a6a56839b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:32.183838 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d54bd2f1-8a91-4aaa-9920-3a1a6a56839b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:32.184285 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d54bd2f1-8a91-4aaa-9920-3a1a6a56839b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:32.185093 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d54bd2f1-8a91-4aaa-9920-3a1a6a56839b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:32.185522 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d54bd2f1-8a91-4aaa-9920-3a1a6a56839b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:32.210430 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-151cdcc7-2350-4263-8465-ec661e8dfa1d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00/os-volume_attachments/4ccbe085-6ec9-46ac-b420-58ecb001a687" status: 202 len: 0 microversion: 2.1 time: 0.178785 Jul 04 10:13:32.211367 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 279/554] 10.222.0.79 () {58 vars in 1415 bytes} [Mon Jul 4 10:13:32 2022] DELETE /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00/os-volume_attachments/4ccbe085-6ec9-46ac-b420-58ecb001a687 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 10:13:32.220471 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-c5ab99b6-0f94-45fb-b170-79761e87c0c1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:32.221530 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-c5ab99b6-0f94-45fb-b170-79761e87c0c1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a936822b-ef8c-42ad-9510-194756830a00] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:32.228270 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c5ab99b6-0f94-45fb-b170-79761e87c0c1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:32.228720 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c5ab99b6-0f94-45fb-b170-79761e87c0c1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:32.229484 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c5ab99b6-0f94-45fb-b170-79761e87c0c1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:32.229938 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c5ab99b6-0f94-45fb-b170-79761e87c0c1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:32.259645 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-c5ab99b6-0f94-45fb-b170-79761e87c0c1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043002 Jul 04 10:13:32.260235 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 280/555] 10.222.0.79 () {58 vars in 1301 bytes} [Mon Jul 4 10:13:32 2022] GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 10:13:32.325122 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-d54bd2f1-8a91-4aaa-9920-3a1a6a56839b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:32.336225 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-d54bd2f1-8a91-4aaa-9920-3a1a6a56839b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1690 microversion: 2.1 time: 0.163598 Jul 04 10:13:32.336799 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 276/556] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:32 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:32.397497 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-c0863485-adc2-495f-ad02-b7bcf88ee48c tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:32.398428 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-c0863485-adc2-495f-ad02-b7bcf88ee48c tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:32.405987 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c0863485-adc2-495f-ad02-b7bcf88ee48c tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:32.406568 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c0863485-adc2-495f-ad02-b7bcf88ee48c tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:32.407406 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c0863485-adc2-495f-ad02-b7bcf88ee48c tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:32.407905 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c0863485-adc2-495f-ad02-b7bcf88ee48c tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:32.510689 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-95017e58-9454-49cb-be92-4e77a1eadae9 req-7c358fa3-1f19-4f4b-aaa2-2a4573673d31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "383b09a2-bd4d-450c-9be6-413d465e3f90", "name": "network-vif-plugged", "status": "completed", "tag": "f3ced8cf-b87b-4d22-b190-3b0019183ff9"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:13:32.522175 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-95017e58-9454-49cb-be92-4e77a1eadae9 req-7c358fa3-1f19-4f4b-aaa2-2a4573673d31 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:32.522728 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-95017e58-9454-49cb-be92-4e77a1eadae9 req-7c358fa3-1f19-4f4b-aaa2-2a4573673d31 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:32.537098 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-95017e58-9454-49cb-be92-4e77a1eadae9 req-7c358fa3-1f19-4f4b-aaa2-2a4573673d31 service nova] Creating event network-vif-plugged:f3ced8cf-b87b-4d22-b190-3b0019183ff9 for instance 383b09a2-bd4d-450c-9be6-413d465e3f90 on hv-cinder-84841 Jul 04 10:13:32.542806 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-95017e58-9454-49cb-be92-4e77a1eadae9 req-7c358fa3-1f19-4f4b-aaa2-2a4573673d31 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035989 Jul 04 10:13:32.543609 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 277/557] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:13:32.544732 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-c0863485-adc2-495f-ad02-b7bcf88ee48c tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:32.552488 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-c0863485-adc2-495f-ad02-b7bcf88ee48c tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90" status: 200 len: 1362 microversion: 2.1 time: 0.159589 Jul 04 10:13:32.553197 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 281/558] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:32 2022] GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:33.276535 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-ecf3731f-de67-4a8e-a966-c30cd2105b07 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:33.277813 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-ecf3731f-de67-4a8e-a966-c30cd2105b07 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a936822b-ef8c-42ad-9510-194756830a00] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:33.286455 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ecf3731f-de67-4a8e-a966-c30cd2105b07 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:33.286972 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ecf3731f-de67-4a8e-a966-c30cd2105b07 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:33.287859 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ecf3731f-de67-4a8e-a966-c30cd2105b07 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:33.288365 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ecf3731f-de67-4a8e-a966-c30cd2105b07 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:33.292753 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:13:33.323493 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-ecf3731f-de67-4a8e-a966-c30cd2105b07 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053619 Jul 04 10:13:33.324045 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 278/559] 10.222.0.79 () {58 vars in 1301 bytes} [Mon Jul 4 10:13:33 2022] GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:13:33.354240 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-c6bcb4a5-8bd3-4004-b48d-c497354f696c tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:33.354837 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-c6bcb4a5-8bd3-4004-b48d-c497354f696c tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:33.361407 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c6bcb4a5-8bd3-4004-b48d-c497354f696c tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:33.361884 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c6bcb4a5-8bd3-4004-b48d-c497354f696c tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:33.362671 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c6bcb4a5-8bd3-4004-b48d-c497354f696c tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:33.363098 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c6bcb4a5-8bd3-4004-b48d-c497354f696c tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:33.503260 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-c6bcb4a5-8bd3-4004-b48d-c497354f696c tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:33.510971 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-c6bcb4a5-8bd3-4004-b48d-c497354f696c tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1690 microversion: 2.1 time: 0.160556 Jul 04 10:13:33.511532 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 282/560] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:33 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:33.569577 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-1587ab76-c598-44a0-9107-d718ef1cb61d tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:33.570205 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-1587ab76-c598-44a0-9107-d718ef1cb61d tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:33.576967 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1587ab76-c598-44a0-9107-d718ef1cb61d tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:33.577400 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1587ab76-c598-44a0-9107-d718ef1cb61d tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:33.578187 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1587ab76-c598-44a0-9107-d718ef1cb61d tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:33.578611 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1587ab76-c598-44a0-9107-d718ef1cb61d tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:33.714271 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-1587ab76-c598-44a0-9107-d718ef1cb61d tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:33.725898 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-1587ab76-c598-44a0-9107-d718ef1cb61d tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90" status: 200 len: 1362 microversion: 2.1 time: 0.159923 Jul 04 10:13:33.726590 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 279/561] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:33 2022] GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:34.341174 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2b03b6a2-a0fd-4b1b-9730-55152b068a10 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:34.342837 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-2b03b6a2-a0fd-4b1b-9730-55152b068a10 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a936822b-ef8c-42ad-9510-194756830a00] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:34.353402 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2b03b6a2-a0fd-4b1b-9730-55152b068a10 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:34.354050 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2b03b6a2-a0fd-4b1b-9730-55152b068a10 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:34.354841 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2b03b6a2-a0fd-4b1b-9730-55152b068a10 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:34.355412 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2b03b6a2-a0fd-4b1b-9730-55152b068a10 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:34.387706 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-2b03b6a2-a0fd-4b1b-9730-55152b068a10 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053697 Jul 04 10:13:34.388178 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 283/562] 10.222.0.79 () {58 vars in 1301 bytes} [Mon Jul 4 10:13:34 2022] GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:13:34.530656 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-9257b166-771d-45fe-93a9-6492b21ac0ba tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:34.531368 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-9257b166-771d-45fe-93a9-6492b21ac0ba tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:34.539936 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9257b166-771d-45fe-93a9-6492b21ac0ba tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:34.540722 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9257b166-771d-45fe-93a9-6492b21ac0ba tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:34.541679 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9257b166-771d-45fe-93a9-6492b21ac0ba tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:34.542241 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9257b166-771d-45fe-93a9-6492b21ac0ba tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:34.686338 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-9257b166-771d-45fe-93a9-6492b21ac0ba tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:34.698691 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-9257b166-771d-45fe-93a9-6492b21ac0ba tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1690 microversion: 2.1 time: 0.172672 Jul 04 10:13:34.699383 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 280/563] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:34 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1690 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:34.743693 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-a2461228-b3a6-4ea6-b3c3-b9851fabfdd0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:34.744292 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-a2461228-b3a6-4ea6-b3c3-b9851fabfdd0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:34.750736 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a2461228-b3a6-4ea6-b3c3-b9851fabfdd0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:34.751207 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a2461228-b3a6-4ea6-b3c3-b9851fabfdd0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:34.751969 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a2461228-b3a6-4ea6-b3c3-b9851fabfdd0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:34.752398 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a2461228-b3a6-4ea6-b3c3-b9851fabfdd0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:34.756472 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:13:34.892440 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-a2461228-b3a6-4ea6-b3c3-b9851fabfdd0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:34.900939 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-a2461228-b3a6-4ea6-b3c3-b9851fabfdd0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90" status: 200 len: 1362 microversion: 2.1 time: 0.161189 Jul 04 10:13:34.901519 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 284/564] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:34 2022] GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:35.399635 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-5bb7a9a6-6dd1-43ac-a5a9-dc003c78b7cb tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:35.400565 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-5bb7a9a6-6dd1-43ac-a5a9-dc003c78b7cb tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a936822b-ef8c-42ad-9510-194756830a00] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:35.402483 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell0:SELECT=2 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:13:35.407900 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5bb7a9a6-6dd1-43ac-a5a9-dc003c78b7cb tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:35.408338 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5bb7a9a6-6dd1-43ac-a5a9-dc003c78b7cb tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:35.409097 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5bb7a9a6-6dd1-43ac-a5a9-dc003c78b7cb tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:35.409522 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5bb7a9a6-6dd1-43ac-a5a9-dc003c78b7cb tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:35.438012 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-5bb7a9a6-6dd1-43ac-a5a9-dc003c78b7cb tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042474 Jul 04 10:13:35.438571 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 281/565] 10.222.0.79 () {58 vars in 1301 bytes} [Mon Jul 4 10:13:35 2022] GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:13:35.720609 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5c5fbf35-1e18-4350-a86b-b41f8b551b23 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:35.721210 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-5c5fbf35-1e18-4350-a86b-b41f8b551b23 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:35.723131 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:13:35.723817 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=10 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:13:35.730047 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5c5fbf35-1e18-4350-a86b-b41f8b551b23 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:35.730489 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5c5fbf35-1e18-4350-a86b-b41f8b551b23 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:35.731243 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5c5fbf35-1e18-4350-a86b-b41f8b551b23 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:35.731669 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5c5fbf35-1e18-4350-a86b-b41f8b551b23 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:35.866666 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-5c5fbf35-1e18-4350-a86b-b41f8b551b23 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:35.878044 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-5c5fbf35-1e18-4350-a86b-b41f8b551b23 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1690 microversion: 2.1 time: 0.161213 Jul 04 10:13:35.878771 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 285/566] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:35 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:35.918322 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-3b7d9f72-9a58-4d26-9e42-24c9d6717f83 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:35.918848 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-3b7d9f72-9a58-4d26-9e42-24c9d6717f83 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:35.925527 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3b7d9f72-9a58-4d26-9e42-24c9d6717f83 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:35.925963 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3b7d9f72-9a58-4d26-9e42-24c9d6717f83 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:35.926740 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3b7d9f72-9a58-4d26-9e42-24c9d6717f83 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:35.927155 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3b7d9f72-9a58-4d26-9e42-24c9d6717f83 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:36.128569 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-3b7d9f72-9a58-4d26-9e42-24c9d6717f83 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:36.137715 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-3b7d9f72-9a58-4d26-9e42-24c9d6717f83 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90" status: 200 len: 1362 microversion: 2.1 time: 0.223154 Jul 04 10:13:36.138605 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 282/567] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:35 2022] GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90 => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:36.452647 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-7306c5cc-c911-4273-b43b-a40b827693c8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:36.453755 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-7306c5cc-c911-4273-b43b-a40b827693c8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a936822b-ef8c-42ad-9510-194756830a00] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:36.461405 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7306c5cc-c911-4273-b43b-a40b827693c8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:36.462163 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7306c5cc-c911-4273-b43b-a40b827693c8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:36.463592 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7306c5cc-c911-4273-b43b-a40b827693c8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:36.464107 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7306c5cc-c911-4273-b43b-a40b827693c8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:36.497812 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-7306c5cc-c911-4273-b43b-a40b827693c8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050170 Jul 04 10:13:36.501757 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 286/568] 10.222.0.79 () {58 vars in 1301 bytes} [Mon Jul 4 10:13:36 2022] GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:13:36.895428 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-b1d42b48-0a6d-43a5-904a-0387ffc7de4b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:36.896032 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-b1d42b48-0a6d-43a5-904a-0387ffc7de4b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:36.902812 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b1d42b48-0a6d-43a5-904a-0387ffc7de4b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:36.903266 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b1d42b48-0a6d-43a5-904a-0387ffc7de4b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:36.904031 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b1d42b48-0a6d-43a5-904a-0387ffc7de4b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:36.904452 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b1d42b48-0a6d-43a5-904a-0387ffc7de4b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:37.159621 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-75d32f51-c8c8-474f-86b7-43b3e3cec69e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:37.160223 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-75d32f51-c8c8-474f-86b7-43b3e3cec69e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:37.167968 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-75d32f51-c8c8-474f-86b7-43b3e3cec69e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:37.168471 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-75d32f51-c8c8-474f-86b7-43b3e3cec69e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:37.169223 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-75d32f51-c8c8-474f-86b7-43b3e3cec69e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:37.169650 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-75d32f51-c8c8-474f-86b7-43b3e3cec69e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:37.179987 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-b1d42b48-0a6d-43a5-904a-0387ffc7de4b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:37.196194 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-b1d42b48-0a6d-43a5-904a-0387ffc7de4b tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1690 microversion: 2.1 time: 0.304718 Jul 04 10:13:37.197453 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 283/569] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:36 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1690 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:37.459600 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-75d32f51-c8c8-474f-86b7-43b3e3cec69e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:37.468294 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-75d32f51-c8c8-474f-86b7-43b3e3cec69e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90" status: 200 len: 1362 microversion: 2.1 time: 0.312982 Jul 04 10:13:37.469503 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 287/570] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:37 2022] GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90 => generated 1362 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:37.495557 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-47110f87-4cf9-48e8-82b3-e3e96f031c4c req-ec30b4ab-1a6c-4bfa-8cf3-2590c15c0a3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cae1c9c4-3ee8-4aae-8911-21df5f3c37df", "name": "network-vif-deleted", "tag": "983beb0b-565d-4f4f-b77c-f373196c5bdc"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:13:37.505140 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-47110f87-4cf9-48e8-82b3-e3e96f031c4c req-ec30b4ab-1a6c-4bfa-8cf3-2590c15c0a3d service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:37.506050 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-47110f87-4cf9-48e8-82b3-e3e96f031c4c req-ec30b4ab-1a6c-4bfa-8cf3-2590c15c0a3d service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:37.510051 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f05a415b-986b-4c1c-b8ac-3d4d5b25c0d8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:37.511861 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f05a415b-986b-4c1c-b8ac-3d4d5b25c0d8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a936822b-ef8c-42ad-9510-194756830a00] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:37.521147 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f05a415b-986b-4c1c-b8ac-3d4d5b25c0d8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:37.521998 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f05a415b-986b-4c1c-b8ac-3d4d5b25c0d8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:37.522913 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f05a415b-986b-4c1c-b8ac-3d4d5b25c0d8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:37.523291 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-47110f87-4cf9-48e8-82b3-e3e96f031c4c req-ec30b4ab-1a6c-4bfa-8cf3-2590c15c0a3d service nova] Creating event network-vif-deleted:983beb0b-565d-4f4f-b77c-f373196c5bdc for instance cae1c9c4-3ee8-4aae-8911-21df5f3c37df on hv-cinder-84841 Jul 04 10:13:37.523551 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f05a415b-986b-4c1c-b8ac-3d4d5b25c0d8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:37.530000 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-47110f87-4cf9-48e8-82b3-e3e96f031c4c req-ec30b4ab-1a6c-4bfa-8cf3-2590c15c0a3d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038491 Jul 04 10:13:37.534240 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 284/571] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:13:37.558411 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f05a415b-986b-4c1c-b8ac-3d4d5b25c0d8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053436 Jul 04 10:13:37.559003 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 288/572] 10.222.0.79 () {58 vars in 1301 bytes} [Mon Jul 4 10:13:37 2022] GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 10:13:37.619230 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-cc1c8319-61c2-4d80-af95-6bd963b794fd tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:37.619750 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-cc1c8319-61c2-4d80-af95-6bd963b794fd tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a936822b-ef8c-42ad-9510-194756830a00] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:37.626404 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-cc1c8319-61c2-4d80-af95-6bd963b794fd tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:37.626845 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-cc1c8319-61c2-4d80-af95-6bd963b794fd tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:37.627636 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-cc1c8319-61c2-4d80-af95-6bd963b794fd tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:37.628061 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-cc1c8319-61c2-4d80-af95-6bd963b794fd tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:37.653131 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-cc1c8319-61c2-4d80-af95-6bd963b794fd tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a936822b-ef8c-42ad-9510-194756830a00] Going to try to terminate instance {{(pid=117866) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 10:13:37.732757 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-cc1c8319-61c2-4d80-af95-6bd963b794fd tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00" status: 204 len: 0 microversion: 2.1 time: 0.117561 Jul 04 10:13:37.733517 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 285/573] 10.222.0.79 () {58 vars in 1238 bytes} [Mon Jul 4 10:13:37 2022] DELETE /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 10:13:37.741953 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-c725c213-3e12-4455-95c2-c4a8ade15620 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:37.742833 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-c725c213-3e12-4455-95c2-c4a8ade15620 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a936822b-ef8c-42ad-9510-194756830a00] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:37.749465 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c725c213-3e12-4455-95c2-c4a8ade15620 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:37.750304 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c725c213-3e12-4455-95c2-c4a8ade15620 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:37.751317 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c725c213-3e12-4455-95c2-c4a8ade15620 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:37.751968 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c725c213-3e12-4455-95c2-c4a8ade15620 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:37.960922 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-c725c213-3e12-4455-95c2-c4a8ade15620 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:37.969198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-c725c213-3e12-4455-95c2-c4a8ade15620 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00" status: 200 len: 1680 microversion: 2.1 time: 0.231032 Jul 04 10:13:37.969902 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 289/574] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:37 2022] GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00 => generated 1680 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:38.214913 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-22d865bd-a6e7-451a-9b13-f3ea427db0d7 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:38.215949 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-22d865bd-a6e7-451a-9b13-f3ea427db0d7 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:38.222886 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-22d865bd-a6e7-451a-9b13-f3ea427db0d7 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:38.223325 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-22d865bd-a6e7-451a-9b13-f3ea427db0d7 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:38.224086 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-22d865bd-a6e7-451a-9b13-f3ea427db0d7 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:38.224516 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-22d865bd-a6e7-451a-9b13-f3ea427db0d7 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:38.292936 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-22d865bd-a6e7-451a-9b13-f3ea427db0d7 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:38.300546 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-22d865bd-a6e7-451a-9b13-f3ea427db0d7 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1330 microversion: 2.1 time: 0.090046 Jul 04 10:13:38.301113 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 286/575] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:38 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1330 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:38.486067 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-9204d5a3-b7aa-4906-8563-3050186101c2 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:38.486719 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-9204d5a3-b7aa-4906-8563-3050186101c2 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:38.494046 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9204d5a3-b7aa-4906-8563-3050186101c2 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:38.494559 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9204d5a3-b7aa-4906-8563-3050186101c2 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:38.495421 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9204d5a3-b7aa-4906-8563-3050186101c2 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:38.495848 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9204d5a3-b7aa-4906-8563-3050186101c2 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:38.630564 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-9204d5a3-b7aa-4906-8563-3050186101c2 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:38.638770 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-9204d5a3-b7aa-4906-8563-3050186101c2 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90" status: 200 len: 1548 microversion: 2.1 time: 0.156600 Jul 04 10:13:38.639287 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 290/576] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:38 2022] GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:38.655822 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-0cd9f4ef-53c6-4c73-8d08-261afb95c56e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:38.656323 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-0cd9f4ef-53c6-4c73-8d08-261afb95c56e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:38.662580 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0cd9f4ef-53c6-4c73-8d08-261afb95c56e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:38.663014 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0cd9f4ef-53c6-4c73-8d08-261afb95c56e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:38.663792 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0cd9f4ef-53c6-4c73-8d08-261afb95c56e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:38.664195 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0cd9f4ef-53c6-4c73-8d08-261afb95c56e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:38.742315 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-0cd9f4ef-53c6-4c73-8d08-261afb95c56e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090022 Jul 04 10:13:38.743525 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 287/577] 10.222.0.79 () {58 vars in 1274 bytes} [Mon Jul 4 10:13:38 2022] GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:13:38.987750 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-9dbcecb1-a42b-4711-a13d-2b5e20c581fa tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:38.988494 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-9dbcecb1-a42b-4711-a13d-2b5e20c581fa tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a936822b-ef8c-42ad-9510-194756830a00] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:38.996333 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9dbcecb1-a42b-4711-a13d-2b5e20c581fa tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:38.996777 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9dbcecb1-a42b-4711-a13d-2b5e20c581fa tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:38.997504 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9dbcecb1-a42b-4711-a13d-2b5e20c581fa tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:38.997961 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9dbcecb1-a42b-4711-a13d-2b5e20c581fa tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:39.317307 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-22c422db-4ac4-4533-8006-ad75c9e7d1d8 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:39.317929 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-22c422db-4ac4-4533-8006-ad75c9e7d1d8 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:39.325314 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-22c422db-4ac4-4533-8006-ad75c9e7d1d8 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:39.325788 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-22c422db-4ac4-4533-8006-ad75c9e7d1d8 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:39.326569 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-22c422db-4ac4-4533-8006-ad75c9e7d1d8 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:39.326994 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-22c422db-4ac4-4533-8006-ad75c9e7d1d8 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:39.362311 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-22c422db-4ac4-4533-8006-ad75c9e7d1d8 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:39.362723 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-22c422db-4ac4-4533-8006-ad75c9e7d1d8 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:39.363164 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.objects.instance [None req-22c422db-4ac4-4533-8006-ad75c9e7d1d8 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lazy-loading 'fault' on Instance uuid cae1c9c4-3ee8-4aae-8911-21df5f3c37df {{(pid=117866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 10:13:39.523438 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-22c422db-4ac4-4533-8006-ad75c9e7d1d8 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:39.532084 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-22c422db-4ac4-4533-8006-ad75c9e7d1d8 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 200 len: 1335 microversion: 2.1 time: 0.219218 Jul 04 10:13:39.532907 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 288/578] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:39 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 1335 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:39.630154 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-9dbcecb1-a42b-4711-a13d-2b5e20c581fa tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:39.639097 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-9dbcecb1-a42b-4711-a13d-2b5e20c581fa tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00" status: 200 len: 1680 microversion: 2.1 time: 0.655740 Jul 04 10:13:39.640027 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 291/579] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:38 2022] GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00 => generated 1680 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:40.612382 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-84b38ec9-b289-451a-bd7f-f9131e3c53bc tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:40.613067 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-84b38ec9-b289-451a-bd7f-f9131e3c53bc tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: cae1c9c4-3ee8-4aae-8911-21df5f3c37df] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:40.621381 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-84b38ec9-b289-451a-bd7f-f9131e3c53bc tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:40.621999 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-84b38ec9-b289-451a-bd7f-f9131e3c53bc tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:40.622854 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-84b38ec9-b289-451a-bd7f-f9131e3c53bc tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:40.624033 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-84b38ec9-b289-451a-bd7f-f9131e3c53bc tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:40.641342 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.wsgi [None req-84b38ec9-b289-451a-bd7f-f9131e3c53bc tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] HTTP exception thrown: Instance cae1c9c4-3ee8-4aae-8911-21df5f3c37df could not be found. Jul 04 10:13:40.643114 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-84b38ec9-b289-451a-bd7f-f9131e3c53bc tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Request method failure captured: Jul 04 10:13:40.643114 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: request: GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df HTTP/1.1 Jul 04 10:13:40.643114 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept: application/json Jul 04 10:13:40.643114 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept-Encoding: identity Jul 04 10:13:40.643114 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Connection: close Jul 04 10:13:40.643114 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Length: 0 Jul 04 10:13:40.643114 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Type: application/json Jul 04 10:13:40.643114 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Host: 10.222.0.79 Jul 04 10:13:40.643114 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Openstack-System-Scope: None Jul 04 10:13:40.643114 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: User-Agent: python-urllib3/1.26.9 Jul 04 10:13:40.643114 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Auth-Token: gAAAAABiwrwoMkd-FZrLDL5-aiRWEi2tqP5Y9aVcYuzksosW1VeQBqKJ-M1OWBbervr9826WxI3yk8EyOa512EHvhSat68LXFU2P2jP3EEjFTBdF0aQwIXnaeXxxjkpaGKt1qebXvZBxiG3u8qxwquzbjrAQDdrYWk79BjtmAHI2EEpansDRzwg Jul 04 10:13:40.643114 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Id: None Jul 04 10:13:40.643114 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Name: None Jul 04 10:13:40.643114 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Identity-Status: Confirmed Jul 04 10:13:40.643114 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Is-Admin-Project: True Jul 04 10:13:40.643114 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Id: default Jul 04 10:13:40.643114 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Name: Default Jul 04 10:13:40.643114 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Id: 7f101e48ae9b4936a6d1b7bae000d7e1 Jul 04 10:13:40.643114 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1112364786 Jul 04 10:13:40.643114 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Role: reader,member Jul 04 10:13:40.643114 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Roles: reader,member Jul 04 10:13:40.644646 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7f101e48ae9b4936a6d1b7bae000d7e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7f101e48ae9b4936a6d1b7bae000d7e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7f101e48ae9b4936a6d1b7bae000d7e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7f101e48ae9b4936a6d1b7bae000d7e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:13:40.644646 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1112364786 Jul 04 10:13:40.644646 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Id: 7f101e48ae9b4936a6d1b7bae000d7e1 Jul 04 10:13:40.644646 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1112364786 Jul 04 10:13:40.644646 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User: tempest-ServerRescueNegativeTestJSON-1112364786-project Jul 04 10:13:40.644646 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Id: default Jul 04 10:13:40.644646 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Name: Default Jul 04 10:13:40.644646 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Id: fc9c26318d6c41f6b9455153f0d0e55b Jul 04 10:13:40.644646 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1112364786-project Jul 04 10:13:40.644646 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: method: > Jul 04 10:13:40.644646 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: exception: Instance cae1c9c4-3ee8-4aae-8911-21df5f3c37df could not be found. Jul 04 10:13:40.644646 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: action_args: {'id': 'cae1c9c4-3ee8-4aae-8911-21df5f3c37df'} Jul 04 10:13:40.645556 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:13:40.645556 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:13:40.645556 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:13:40.645556 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:13:40.645556 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:13:40.645556 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:13:40.645556 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:13:40.645556 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:13:40.645556 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:13:40.645556 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:13:40.645556 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cae1c9c4-3ee8-4aae-8911-21df5f3c37df could not be found. Jul 04 10:13:40.645556 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:13:40.645556 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:13:40.645556 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:13:40.645556 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:13:40.645556 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:13:40.645556 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:13:40.645556 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:13:40.645556 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:13:40.645556 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:13:40.647013 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:13:40.647013 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 10:13:40.647013 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 10:13:40.647013 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:13:40.647013 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:13:40.647013 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:13:40.647013 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:13:40.647013 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cae1c9c4-3ee8-4aae-8911-21df5f3c37df could not be found. Jul 04 10:13:40.647013 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:13:40.647013 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:13:40.647013 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:13:40.647013 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:13:40.647013 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:13:40.647013 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:13:40.647013 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:13:40.647013 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:13:40.647013 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cae1c9c4-3ee8-4aae-8911-21df5f3c37df could not be found. Jul 04 10:13:40.647013 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:13:40.649673 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-84b38ec9-b289-451a-bd7f-f9131e3c53bc tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Returning 404 to user: Instance cae1c9c4-3ee8-4aae-8911-21df5f3c37df could not be found. {{(pid=117866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:13:40.649673 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-84b38ec9-b289-451a-bd7f-f9131e3c53bc tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df" status: 404 len: 111 microversion: 2.1 time: 0.099842 Jul 04 10:13:40.649673 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 289/580] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:40 2022] GET /compute/v2.1/servers/cae1c9c4-3ee8-4aae-8911-21df5f3c37df => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:13:40.657844 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-2921c9ec-d10f-4575-833b-ecc0cf9dcc05 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:40.657985 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-7a2f96f4-7206-4f1e-b9ca-4e6b375f17c1 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '.version_select at 0x7f28080628b0>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:40.658446 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-2921c9ec-d10f-4575-833b-ecc0cf9dcc05 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a936822b-ef8c-42ad-9510-194756830a00] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:40.665698 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2921c9ec-d10f-4575-833b-ecc0cf9dcc05 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:40.666196 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2921c9ec-d10f-4575-833b-ecc0cf9dcc05 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:40.667548 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2921c9ec-d10f-4575-833b-ecc0cf9dcc05 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:40.667548 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2921c9ec-d10f-4575-833b-ecc0cf9dcc05 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:40.693498 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-7a2f96f4-7206-4f1e-b9ca-4e6b375f17c1 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2115852548" status: 202 len: 0 microversion: 2.1 time: 0.039882 Jul 04 10:13:40.694172 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 292/581] 10.222.0.79 () {58 vars in 1220 bytes} [Mon Jul 4 10:13:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2115852548 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 10:13:40.703964 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-b2a10220-ca43-4c7a-bb8d-fd603448645c req-b91aa5ea-514a-4e51-86f5-e39e76012ebb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "383b09a2-bd4d-450c-9be6-413d465e3f90", "tag": "f3ced8cf-b87b-4d22-b190-3b0019183ff9"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:13:40.719653 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-b2a10220-ca43-4c7a-bb8d-fd603448645c req-b91aa5ea-514a-4e51-86f5-e39e76012ebb service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:40.720084 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-b2a10220-ca43-4c7a-bb8d-fd603448645c req-b91aa5ea-514a-4e51-86f5-e39e76012ebb service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:40.734223 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-b2a10220-ca43-4c7a-bb8d-fd603448645c req-b91aa5ea-514a-4e51-86f5-e39e76012ebb service nova] Creating event network-changed:f3ced8cf-b87b-4d22-b190-3b0019183ff9 for instance 383b09a2-bd4d-450c-9be6-413d465e3f90 on hv-cinder-84841 Jul 04 10:13:40.739758 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-b2a10220-ca43-4c7a-bb8d-fd603448645c req-b91aa5ea-514a-4e51-86f5-e39e76012ebb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040735 Jul 04 10:13:40.740369 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 293/582] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:13:40.778344 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-2921c9ec-d10f-4575-833b-ecc0cf9dcc05 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:40.788343 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-2921c9ec-d10f-4575-833b-ecc0cf9dcc05 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00" status: 200 len: 1613 microversion: 2.1 time: 0.135039 Jul 04 10:13:40.800623 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 290/583] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:40 2022] GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00 => generated 1613 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:41.806623 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-247dc3ab-4a60-405a-9e92-dfc04148edfc tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:41.808085 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-247dc3ab-4a60-405a-9e92-dfc04148edfc tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a936822b-ef8c-42ad-9510-194756830a00] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:41.815443 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-247dc3ab-4a60-405a-9e92-dfc04148edfc tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:41.816080 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-247dc3ab-4a60-405a-9e92-dfc04148edfc tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:41.817001 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-247dc3ab-4a60-405a-9e92-dfc04148edfc tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:41.818032 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-247dc3ab-4a60-405a-9e92-dfc04148edfc tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:41.849726 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-247dc3ab-4a60-405a-9e92-dfc04148edfc tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:41.850167 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-247dc3ab-4a60-405a-9e92-dfc04148edfc tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:41.850599 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.objects.instance [None req-247dc3ab-4a60-405a-9e92-dfc04148edfc tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lazy-loading 'fault' on Instance uuid a936822b-ef8c-42ad-9510-194756830a00 {{(pid=117865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 10:13:41.909258 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-247dc3ab-4a60-405a-9e92-dfc04148edfc tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:41.927788 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-247dc3ab-4a60-405a-9e92-dfc04148edfc tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00" status: 200 len: 1330 microversion: 2.1 time: 0.124320 Jul 04 10:13:41.928658 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 294/584] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:41 2022] GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00 => generated 1330 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:42.757098 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-8a9dcfb5-c62e-4e03-928d-36ba166cf21b req-f8c560da-23fb-4f39-9b09-c5d7c34dafe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a936822b-ef8c-42ad-9510-194756830a00", "name": "network-vif-deleted", "tag": "111fd0b9-55ad-4e25-93cf-69456c116c74"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:13:42.766287 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-8a9dcfb5-c62e-4e03-928d-36ba166cf21b req-f8c560da-23fb-4f39-9b09-c5d7c34dafe6 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:42.766722 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-8a9dcfb5-c62e-4e03-928d-36ba166cf21b req-f8c560da-23fb-4f39-9b09-c5d7c34dafe6 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:42.779235 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-8a9dcfb5-c62e-4e03-928d-36ba166cf21b req-f8c560da-23fb-4f39-9b09-c5d7c34dafe6 service nova] Creating event network-vif-deleted:111fd0b9-55ad-4e25-93cf-69456c116c74 for instance a936822b-ef8c-42ad-9510-194756830a00 on hv-cinder-84841 Jul 04 10:13:42.784613 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-8a9dcfb5-c62e-4e03-928d-36ba166cf21b req-f8c560da-23fb-4f39-9b09-c5d7c34dafe6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031472 Jul 04 10:13:42.785223 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 291/585] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:13:42.950276 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-a5eaf13b-5226-415c-80af-37811a9f59b8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:42.951129 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-a5eaf13b-5226-415c-80af-37811a9f59b8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a936822b-ef8c-42ad-9510-194756830a00] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:42.961365 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a5eaf13b-5226-415c-80af-37811a9f59b8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:42.962143 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a5eaf13b-5226-415c-80af-37811a9f59b8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:42.963069 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a5eaf13b-5226-415c-80af-37811a9f59b8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:42.963514 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a5eaf13b-5226-415c-80af-37811a9f59b8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:42.977299 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-a5eaf13b-5226-415c-80af-37811a9f59b8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] HTTP exception thrown: Instance a936822b-ef8c-42ad-9510-194756830a00 could not be found. Jul 04 10:13:42.979172 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-a5eaf13b-5226-415c-80af-37811a9f59b8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Request method failure captured: Jul 04 10:13:42.979172 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: request: GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00 HTTP/1.1 Jul 04 10:13:42.979172 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept: application/json Jul 04 10:13:42.979172 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept-Encoding: identity Jul 04 10:13:42.979172 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Connection: close Jul 04 10:13:42.979172 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Length: 0 Jul 04 10:13:42.979172 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Type: application/json Jul 04 10:13:42.979172 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Host: 10.222.0.79 Jul 04 10:13:42.979172 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 04 10:13:42.979172 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 04 10:13:42.979172 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Auth-Token: gAAAAABiwrwvD9yiGE4pStEGBF2Ys-pryu1tx1k2auUnE0PRvpPvnRtEQEaHpqZQ8egutal5ICM4nB9U9UkZUlVAaFmujyok7-zJ_4u8OoD2UCOlqV-Oyun1vIdrrzMPcAwbXsLkKDns-0TZYcaWBDNIYObNG0qh5NpdFBBI5iioapUAgXk4vDM Jul 04 10:13:42.979172 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Id: None Jul 04 10:13:42.979172 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Name: None Jul 04 10:13:42.979172 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 04 10:13:42.979172 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 04 10:13:42.979172 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 04 10:13:42.979172 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 04 10:13:42.979172 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Id: a57f93d66f534107a228d908afa64890 Jul 04 10:13:42.979172 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Name: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:13:42.979172 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Role: reader,member Jul 04 10:13:42.979172 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Roles: reader,member Jul 04 10:13:42.980755 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a57f93d66f534107a228d908afa64890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a57f93d66f534107a228d908afa64890"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a57f93d66f534107a228d908afa64890"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a57f93d66f534107a228d908afa64890"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:13:42.980755 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:13:42.980755 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Id: a57f93d66f534107a228d908afa64890 Jul 04 10:13:42.980755 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:13:42.980755 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User: tempest-AttachVolumeNegativeTest-223944498-project Jul 04 10:13:42.980755 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 04 10:13:42.980755 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 04 10:13:42.980755 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Id: 88d2351fc3b74ef5a530fded1be6b997 Jul 04 10:13:42.980755 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Name: tempest-AttachVolumeNegativeTest-223944498-project Jul 04 10:13:42.980755 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: method: > Jul 04 10:13:42.980755 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: exception: Instance a936822b-ef8c-42ad-9510-194756830a00 could not be found. Jul 04 10:13:42.980755 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: action_args: {'id': 'a936822b-ef8c-42ad-9510-194756830a00'} Jul 04 10:13:42.981514 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:13:42.981514 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:13:42.981514 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:13:42.981514 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:13:42.981514 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:13:42.981514 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:13:42.981514 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:13:42.981514 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:13:42.981514 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:13:42.981514 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:13:42.981514 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a936822b-ef8c-42ad-9510-194756830a00 could not be found. Jul 04 10:13:42.981514 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:13:42.981514 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:13:42.981514 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:13:42.981514 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:13:42.981514 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:13:42.981514 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:13:42.981514 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:13:42.981514 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:13:42.981514 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:13:42.982711 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:13:42.982711 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 10:13:42.982711 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 10:13:42.982711 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:13:42.982711 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:13:42.982711 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:13:42.982711 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:13:42.982711 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a936822b-ef8c-42ad-9510-194756830a00 could not be found. Jul 04 10:13:42.982711 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:13:42.982711 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:13:42.982711 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:13:42.982711 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:13:42.982711 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:13:42.982711 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:13:42.982711 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:13:42.982711 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:13:42.982711 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a936822b-ef8c-42ad-9510-194756830a00 could not be found. Jul 04 10:13:42.982711 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:13:42.983723 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-a5eaf13b-5226-415c-80af-37811a9f59b8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Returning 404 to user: Instance a936822b-ef8c-42ad-9510-194756830a00 could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:13:42.983723 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-a5eaf13b-5226-415c-80af-37811a9f59b8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00" status: 404 len: 111 microversion: 2.1 time: 0.037184 Jul 04 10:13:42.983723 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 295/586] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:42 2022] GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:13:42.990231 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-e0c878c1-b40d-40de-b630-fa4d7d7850d8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '.version_select at 0x7f2808177670>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:43.009796 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-e0c878c1-b40d-40de-b630-fa4d7d7850d8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-904486765" status: 202 len: 0 microversion: 2.1 time: 0.023741 Jul 04 10:13:43.010355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 292/587] 10.222.0.79 () {58 vars in 1217 bytes} [Mon Jul 4 10:13:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-904486765 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 10:13:43.652820 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8a673dee-3e91-41cd-824f-8580c55829f4 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Action: 'create', calling method: .version_select at 0x7f2802f06430>, body: {"keypair": {"name": "tempest-keypair-377818341", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJT4gFfeoLtEawsT1v2k/jo3fhNhj8yBq18mKmNv3LY5S7I4b2f+Mox5IH77I2DLLoPTWBILy+puQhswukw72NOtRNxQecw+J1LBvg1JUFZHo+tg9H5Sz+TMN9+INRc6DA=="}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:13:43.668528 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-8a673dee-3e91-41cd-824f-8580c55829f4 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Getting quotas for project a57f93d66f534107a228d908afa64890. Resources: {'key_pairs'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 10:13:43.670843 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:13:43.673525 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-8a673dee-3e91-41cd-824f-8580c55829f4 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Getting quotas for user 88d2351fc3b74ef5a530fded1be6b997 and project a57f93d66f534107a228d908afa64890. Resources: {'key_pairs'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 10:13:43.698900 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-7597890b-0864-475c-aa0c-5fb336dbe7c9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:43.699136 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-8a673dee-3e91-41cd-824f-8580c55829f4 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050271 Jul 04 10:13:43.699587 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 296/588] 10.222.0.79 () {60 vars in 1158 bytes} [Mon Jul 4 10:13:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:13:43.699834 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-7597890b-0864-475c-aa0c-5fb336dbe7c9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:43.706418 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7597890b-0864-475c-aa0c-5fb336dbe7c9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:43.706917 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7597890b-0864-475c-aa0c-5fb336dbe7c9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:43.707734 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7597890b-0864-475c-aa0c-5fb336dbe7c9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:43.708220 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7597890b-0864-475c-aa0c-5fb336dbe7c9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:43.735060 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-7597890b-0864-475c-aa0c-5fb336dbe7c9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Going to try to terminate instance {{(pid=117866) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 10:13:43.818745 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-7597890b-0864-475c-aa0c-5fb336dbe7c9 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "DELETE /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 204 len: 0 microversion: 2.1 time: 0.123712 Jul 04 10:13:43.819368 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 293/589] 10.222.0.79 () {58 vars in 1238 bytes} [Mon Jul 4 10:13:43 2022] DELETE /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 10:13:43.828211 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-51698bef-0058-43e3-97ba-eb6c51363010 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:43.828939 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-51698bef-0058-43e3-97ba-eb6c51363010 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:43.836012 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-51698bef-0058-43e3-97ba-eb6c51363010 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:43.836557 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-51698bef-0058-43e3-97ba-eb6c51363010 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:43.837483 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-51698bef-0058-43e3-97ba-eb6c51363010 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:43.838094 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-51698bef-0058-43e3-97ba-eb6c51363010 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:44.036056 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-51698bef-0058-43e3-97ba-eb6c51363010 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:44.045192 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-51698bef-0058-43e3-97ba-eb6c51363010 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1507 microversion: 2.1 time: 0.221059 Jul 04 10:13:44.045967 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 297/590] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:43 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1507 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:45.063203 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-72901b02-0567-4a95-93c0-f0632e490701 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:45.063994 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-72901b02-0567-4a95-93c0-f0632e490701 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:45.070850 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-72901b02-0567-4a95-93c0-f0632e490701 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:45.071356 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-72901b02-0567-4a95-93c0-f0632e490701 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:45.072225 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-72901b02-0567-4a95-93c0-f0632e490701 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:45.072654 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-72901b02-0567-4a95-93c0-f0632e490701 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:45.091827 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:13:45.096809 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-d7584404-1661-4267-a308-fb997d0bfa45 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2005083039", "imageRef": "80bd29b0-b77c-4611-be31-69ca559a2d2a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3ebecf3d-37d9-4ade-a898-e313cec92aef"}], "security_groups": [{"name": "tempest-securitygroup--854834321"}], "key_name": "tempest-keypair-377818341", "user_data": "}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:13:45.235852 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-72901b02-0567-4a95-93c0-f0632e490701 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:45.237503 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.network.neutron [None req-d7584404-1661-4267-a308-fb997d0bfa45 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] validate_networks() for [('3ebecf3d-37d9-4ade-a898-e313cec92aef', None, None, None, None, None)] {{(pid=117865) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 10:13:45.244580 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-72901b02-0567-4a95-93c0-f0632e490701 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1507 microversion: 2.1 time: 0.184482 Jul 04 10:13:45.246214 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 294/591] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:45 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1507 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:45.661770 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-d7584404-1661-4267-a308-fb997d0bfa45 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Flavor limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 10:13:45.662353 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-d7584404-1661-4267-a308-fb997d0bfa45 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Image limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 10:13:45.663120 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-d7584404-1661-4267-a308-fb997d0bfa45 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Flavor pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 10:13:45.663771 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-d7584404-1661-4267-a308-fb997d0bfa45 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Image pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 10:13:45.664421 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-d7584404-1661-4267-a308-fb997d0bfa45 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 10:13:45.677566 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d7584404-1661-4267-a308-fb997d0bfa45 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:45.678218 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d7584404-1661-4267-a308-fb997d0bfa45 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:45.679365 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d7584404-1661-4267-a308-fb997d0bfa45 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:45.679910 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d7584404-1661-4267-a308-fb997d0bfa45 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:45.703042 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-d7584404-1661-4267-a308-fb997d0bfa45 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Getting quotas for project a57f93d66f534107a228d908afa64890. Resources: {'cores', 'ram', 'instances'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 10:13:45.707330 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-d7584404-1661-4267-a308-fb997d0bfa45 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Getting quotas for user 88d2351fc3b74ef5a530fded1be6b997 and project a57f93d66f534107a228d908afa64890. Resources: {'cores', 'ram', 'instances'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 10:13:45.719730 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d7584404-1661-4267-a308-fb997d0bfa45 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Going to run 1 instances... {{(pid=117865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 10:13:45.722036 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d7584404-1661-4267-a308-fb997d0bfa45 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a16e6a2a-ad39-4e14-9cee-083afb6e9745] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80bd29b0-b77c-4611-be31-69ca559a2d2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 10:13:45.774235 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-d7584404-1661-4267-a308-fb997d0bfa45 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.682369 Jul 04 10:13:45.774926 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 298/592] 10.222.0.79 () {60 vars in 1146 bytes} [Mon Jul 4 10:13:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 04 10:13:45.785088 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-0a5f2a37-f6d2-4fa2-99c5-f1ba784001cb tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:45.785718 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-0a5f2a37-f6d2-4fa2-99c5-f1ba784001cb tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a16e6a2a-ad39-4e14-9cee-083afb6e9745] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:45.841823 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-0a5f2a37-f6d2-4fa2-99c5-f1ba784001cb tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:45.848718 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-0a5f2a37-f6d2-4fa2-99c5-f1ba784001cb tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745" status: 200 len: 1241 microversion: 2.1 time: 0.067353 Jul 04 10:13:45.849483 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 295/593] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:45 2022] GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:46.266682 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-6fdbe428-c42b-4f54-99ab-cc9f9842daab tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:46.267848 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-6fdbe428-c42b-4f54-99ab-cc9f9842daab tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:46.275828 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6fdbe428-c42b-4f54-99ab-cc9f9842daab tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:46.276593 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6fdbe428-c42b-4f54-99ab-cc9f9842daab tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:46.277366 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6fdbe428-c42b-4f54-99ab-cc9f9842daab tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:46.277854 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6fdbe428-c42b-4f54-99ab-cc9f9842daab tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:46.498613 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-6fdbe428-c42b-4f54-99ab-cc9f9842daab tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:46.506604 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-6fdbe428-c42b-4f54-99ab-cc9f9842daab tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 200 len: 1507 microversion: 2.1 time: 0.247157 Jul 04 10:13:46.507216 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 299/594] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:46 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 1507 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:46.758208 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-89476bd1-be26-48c5-b7d6-aa1a0d67b3f2 req-64a4e886-c0d1-4194-ba8e-052d419fe4e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89a2c77a-967c-4273-a92c-1dbd36cda2dd", "name": "network-vif-deleted", "tag": "f62e5e86-0d6c-4e20-bd83-d59470ae870f"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:13:46.769374 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:13:46.780471 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-89476bd1-be26-48c5-b7d6-aa1a0d67b3f2 req-64a4e886-c0d1-4194-ba8e-052d419fe4e6 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:46.780921 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-89476bd1-be26-48c5-b7d6-aa1a0d67b3f2 req-64a4e886-c0d1-4194-ba8e-052d419fe4e6 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:46.801996 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-89476bd1-be26-48c5-b7d6-aa1a0d67b3f2 req-64a4e886-c0d1-4194-ba8e-052d419fe4e6 service nova] Creating event network-vif-deleted:f62e5e86-0d6c-4e20-bd83-d59470ae870f for instance 89a2c77a-967c-4273-a92c-1dbd36cda2dd on hv-cinder-84841 Jul 04 10:13:46.811472 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-89476bd1-be26-48c5-b7d6-aa1a0d67b3f2 req-64a4e886-c0d1-4194-ba8e-052d419fe4e6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059554 Jul 04 10:13:46.815844 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 296/595] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:13:46.866688 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-458e35f0-2798-4624-a1ec-a1051e949e65 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:46.867394 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-458e35f0-2798-4624-a1ec-a1051e949e65 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a16e6a2a-ad39-4e14-9cee-083afb6e9745] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:46.873807 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-458e35f0-2798-4624-a1ec-a1051e949e65 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:46.874561 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-458e35f0-2798-4624-a1ec-a1051e949e65 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:46.875432 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-458e35f0-2798-4624-a1ec-a1051e949e65 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:46.875966 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-458e35f0-2798-4624-a1ec-a1051e949e65 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:46.972843 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-458e35f0-2798-4624-a1ec-a1051e949e65 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:46.980970 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-458e35f0-2798-4624-a1ec-a1051e949e65 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745" status: 200 len: 1311 microversion: 2.1 time: 0.118518 Jul 04 10:13:46.981573 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 300/596] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:46 2022] GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745 => generated 1311 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:47.523982 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-9464ab53-f01b-42fd-a1c4-7521509e4682 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:47.524865 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-9464ab53-f01b-42fd-a1c4-7521509e4682 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 89a2c77a-967c-4273-a92c-1dbd36cda2dd] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:47.531818 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9464ab53-f01b-42fd-a1c4-7521509e4682 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:47.532296 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9464ab53-f01b-42fd-a1c4-7521509e4682 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:47.533064 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9464ab53-f01b-42fd-a1c4-7521509e4682 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:47.533496 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9464ab53-f01b-42fd-a1c4-7521509e4682 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:47.547530 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.wsgi [None req-9464ab53-f01b-42fd-a1c4-7521509e4682 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] HTTP exception thrown: Instance 89a2c77a-967c-4273-a92c-1dbd36cda2dd could not be found. Jul 04 10:13:47.549193 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-9464ab53-f01b-42fd-a1c4-7521509e4682 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Request method failure captured: Jul 04 10:13:47.549193 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: request: GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd HTTP/1.1 Jul 04 10:13:47.549193 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept: application/json Jul 04 10:13:47.549193 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept-Encoding: identity Jul 04 10:13:47.549193 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Connection: close Jul 04 10:13:47.549193 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Length: 0 Jul 04 10:13:47.549193 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Type: application/json Jul 04 10:13:47.549193 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Host: 10.222.0.79 Jul 04 10:13:47.549193 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Openstack-System-Scope: None Jul 04 10:13:47.549193 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: User-Agent: python-urllib3/1.26.9 Jul 04 10:13:47.549193 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Auth-Token: gAAAAABiwrwoMkd-FZrLDL5-aiRWEi2tqP5Y9aVcYuzksosW1VeQBqKJ-M1OWBbervr9826WxI3yk8EyOa512EHvhSat68LXFU2P2jP3EEjFTBdF0aQwIXnaeXxxjkpaGKt1qebXvZBxiG3u8qxwquzbjrAQDdrYWk79BjtmAHI2EEpansDRzwg Jul 04 10:13:47.549193 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Id: None Jul 04 10:13:47.549193 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Name: None Jul 04 10:13:47.549193 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Identity-Status: Confirmed Jul 04 10:13:47.549193 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Is-Admin-Project: True Jul 04 10:13:47.549193 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Id: default Jul 04 10:13:47.549193 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Name: Default Jul 04 10:13:47.549193 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Id: 7f101e48ae9b4936a6d1b7bae000d7e1 Jul 04 10:13:47.549193 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1112364786 Jul 04 10:13:47.549193 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Role: reader,member Jul 04 10:13:47.549193 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Roles: reader,member Jul 04 10:13:47.550857 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7f101e48ae9b4936a6d1b7bae000d7e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7f101e48ae9b4936a6d1b7bae000d7e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7f101e48ae9b4936a6d1b7bae000d7e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7f101e48ae9b4936a6d1b7bae000d7e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:13:47.550857 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1112364786 Jul 04 10:13:47.550857 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Id: 7f101e48ae9b4936a6d1b7bae000d7e1 Jul 04 10:13:47.550857 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1112364786 Jul 04 10:13:47.550857 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User: tempest-ServerRescueNegativeTestJSON-1112364786-project Jul 04 10:13:47.550857 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Id: default Jul 04 10:13:47.550857 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Name: Default Jul 04 10:13:47.550857 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Id: fc9c26318d6c41f6b9455153f0d0e55b Jul 04 10:13:47.550857 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1112364786-project Jul 04 10:13:47.550857 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: method: > Jul 04 10:13:47.550857 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: exception: Instance 89a2c77a-967c-4273-a92c-1dbd36cda2dd could not be found. Jul 04 10:13:47.550857 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: action_args: {'id': '89a2c77a-967c-4273-a92c-1dbd36cda2dd'} Jul 04 10:13:47.551791 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:13:47.551791 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:13:47.551791 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:13:47.551791 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:13:47.551791 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:13:47.551791 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:13:47.551791 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:13:47.551791 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:13:47.551791 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:13:47.551791 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:13:47.551791 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89a2c77a-967c-4273-a92c-1dbd36cda2dd could not be found. Jul 04 10:13:47.551791 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:13:47.551791 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:13:47.551791 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:13:47.551791 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:13:47.551791 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:13:47.551791 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:13:47.551791 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:13:47.551791 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:13:47.551791 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:13:47.553412 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:13:47.553412 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 10:13:47.553412 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 10:13:47.553412 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:13:47.553412 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:13:47.553412 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:13:47.553412 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:13:47.553412 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89a2c77a-967c-4273-a92c-1dbd36cda2dd could not be found. Jul 04 10:13:47.553412 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:13:47.553412 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:13:47.553412 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:13:47.553412 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:13:47.553412 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:13:47.553412 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:13:47.553412 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:13:47.553412 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:13:47.553412 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89a2c77a-967c-4273-a92c-1dbd36cda2dd could not be found. Jul 04 10:13:47.553412 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:13:47.554988 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-9464ab53-f01b-42fd-a1c4-7521509e4682 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Returning 404 to user: Instance 89a2c77a-967c-4273-a92c-1dbd36cda2dd could not be found. {{(pid=117866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:13:47.554988 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-9464ab53-f01b-42fd-a1c4-7521509e4682 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd" status: 404 len: 111 microversion: 2.1 time: 0.031060 Jul 04 10:13:47.554988 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 297/597] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:47 2022] GET /compute/v2.1/servers/89a2c77a-967c-4273-a92c-1dbd36cda2dd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 04 10:13:47.559993 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-92bfa818-be6c-4e66-aa19-c8da0b06a339 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:47.560546 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-92bfa818-be6c-4e66-aa19-c8da0b06a339 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:47.567562 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-92bfa818-be6c-4e66-aa19-c8da0b06a339 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:47.568135 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-92bfa818-be6c-4e66-aa19-c8da0b06a339 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:47.568968 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-92bfa818-be6c-4e66-aa19-c8da0b06a339 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:47.569460 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-92bfa818-be6c-4e66-aa19-c8da0b06a339 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:47.596007 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-92bfa818-be6c-4e66-aa19-c8da0b06a339 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Going to try to terminate instance {{(pid=117865) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 10:13:47.685133 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-92bfa818-be6c-4e66-aa19-c8da0b06a339 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "DELETE /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120" status: 204 len: 0 microversion: 2.1 time: 0.129219 Jul 04 10:13:47.688830 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 301/598] 10.222.0.79 () {58 vars in 1238 bytes} [Mon Jul 4 10:13:47 2022] DELETE /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 10:13:47.694211 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-eda72166-011b-40e2-966e-4401bcb752db tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:47.694827 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-eda72166-011b-40e2-966e-4401bcb752db tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:47.701702 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-eda72166-011b-40e2-966e-4401bcb752db tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:47.702155 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-eda72166-011b-40e2-966e-4401bcb752db tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:47.702923 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-eda72166-011b-40e2-966e-4401bcb752db tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:47.703358 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-eda72166-011b-40e2-966e-4401bcb752db tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:47.935512 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-eda72166-011b-40e2-966e-4401bcb752db tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:47.944306 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-eda72166-011b-40e2-966e-4401bcb752db tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120" status: 200 len: 1521 microversion: 2.1 time: 0.254086 Jul 04 10:13:47.944896 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 298/599] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:47 2022] GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:48.004486 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2b02c24f-1f8e-49f6-91de-4dc950809498 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:48.005265 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-2b02c24f-1f8e-49f6-91de-4dc950809498 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a16e6a2a-ad39-4e14-9cee-083afb6e9745] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:48.011906 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2b02c24f-1f8e-49f6-91de-4dc950809498 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:48.012452 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2b02c24f-1f8e-49f6-91de-4dc950809498 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:48.013296 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2b02c24f-1f8e-49f6-91de-4dc950809498 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:48.013842 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2b02c24f-1f8e-49f6-91de-4dc950809498 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:48.156790 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-2b02c24f-1f8e-49f6-91de-4dc950809498 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:48.160381 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:13:48.164863 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-2b02c24f-1f8e-49f6-91de-4dc950809498 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745" status: 200 len: 1366 microversion: 2.1 time: 0.164831 Jul 04 10:13:48.165460 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 302/600] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:47 2022] GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:13:48.380570 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-5bc0682f-f810-4bbe-887d-f250adecb89c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:48.381063 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-5bc0682f-f810-4bbe-887d-f250adecb89c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:48.387793 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5bc0682f-f810-4bbe-887d-f250adecb89c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:48.388236 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5bc0682f-f810-4bbe-887d-f250adecb89c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:48.389008 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5bc0682f-f810-4bbe-887d-f250adecb89c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:48.389438 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5bc0682f-f810-4bbe-887d-f250adecb89c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:48.414693 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-5bc0682f-f810-4bbe-887d-f250adecb89c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668/ips" status: 200 len: 149 microversion: 2.20 time: 0.101744 Jul 04 10:13:48.415272 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 299/601] 10.222.0.79 () {60 vars in 1288 bytes} [Mon Jul 4 10:13:48 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668/ips => generated 149 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 10:13:48.966097 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-cccea185-db4a-4303-8205-5310b85de724 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:48.966680 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-cccea185-db4a-4303-8205-5310b85de724 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:48.974443 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cccea185-db4a-4303-8205-5310b85de724 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:48.974956 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cccea185-db4a-4303-8205-5310b85de724 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:48.975781 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cccea185-db4a-4303-8205-5310b85de724 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:48.976249 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cccea185-db4a-4303-8205-5310b85de724 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:49.113075 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-cccea185-db4a-4303-8205-5310b85de724 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:49.123898 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-cccea185-db4a-4303-8205-5310b85de724 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120" status: 200 len: 1521 microversion: 2.1 time: 0.163867 Jul 04 10:13:49.124480 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 303/602] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:48 2022] GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:49.182268 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-1ba80067-5df2-4427-95c3-344082ab14e7 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:49.182879 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-1ba80067-5df2-4427-95c3-344082ab14e7 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a16e6a2a-ad39-4e14-9cee-083afb6e9745] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:49.189924 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1ba80067-5df2-4427-95c3-344082ab14e7 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:49.190374 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1ba80067-5df2-4427-95c3-344082ab14e7 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:49.191134 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1ba80067-5df2-4427-95c3-344082ab14e7 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:49.191562 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1ba80067-5df2-4427-95c3-344082ab14e7 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:49.330467 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-1ba80067-5df2-4427-95c3-344082ab14e7 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:49.343418 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-1ba80067-5df2-4427-95c3-344082ab14e7 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745" status: 200 len: 1366 microversion: 2.1 time: 0.165192 Jul 04 10:13:49.344277 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 300/603] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:49 2022] GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:50.141516 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5cd7ac4e-895b-499e-8255-258a3b1292f0 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:50.142160 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-5cd7ac4e-895b-499e-8255-258a3b1292f0 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:50.149647 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5cd7ac4e-895b-499e-8255-258a3b1292f0 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:50.150101 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5cd7ac4e-895b-499e-8255-258a3b1292f0 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:50.151475 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5cd7ac4e-895b-499e-8255-258a3b1292f0 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:50.151917 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5cd7ac4e-895b-499e-8255-258a3b1292f0 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:50.266790 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-40dfd668-07fa-456c-a5c7-c3cec8bc7e95 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:13:50.267399 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-40dfd668-07fa-456c-a5c7-c3cec8bc7e95 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:50.274301 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-40dfd668-07fa-456c-a5c7-c3cec8bc7e95 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:50.274850 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-40dfd668-07fa-456c-a5c7-c3cec8bc7e95 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:50.275646 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-40dfd668-07fa-456c-a5c7-c3cec8bc7e95 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:50.276078 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-40dfd668-07fa-456c-a5c7-c3cec8bc7e95 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:50.286474 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-5cd7ac4e-895b-499e-8255-258a3b1292f0 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:50.294797 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-5cd7ac4e-895b-499e-8255-258a3b1292f0 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120" status: 200 len: 1521 microversion: 2.1 time: 0.157618 Jul 04 10:13:50.295376 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 304/604] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:50 2022] GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:50.300260 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.objects.instance [None req-40dfd668-07fa-456c-a5c7-c3cec8bc7e95 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lazy-loading 'flavor' on Instance uuid a66cd362-4fe8-499f-850d-6755bd23c668 {{(pid=117866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 10:13:50.361020 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-ecb02a80-e14e-452c-91d7-d3aa34e2ca15 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:50.361769 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-ecb02a80-e14e-452c-91d7-d3aa34e2ca15 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a16e6a2a-ad39-4e14-9cee-083afb6e9745] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:50.368451 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ecb02a80-e14e-452c-91d7-d3aa34e2ca15 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:50.368976 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ecb02a80-e14e-452c-91d7-d3aa34e2ca15 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:50.369884 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ecb02a80-e14e-452c-91d7-d3aa34e2ca15 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:50.370464 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ecb02a80-e14e-452c-91d7-d3aa34e2ca15 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:50.504258 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-ecb02a80-e14e-452c-91d7-d3aa34e2ca15 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:50.511817 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-ecb02a80-e14e-452c-91d7-d3aa34e2ca15 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745" status: 200 len: 1366 microversion: 2.1 time: 0.154907 Jul 04 10:13:50.512599 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 305/605] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:50 2022] GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:50.564798 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-40dfd668-07fa-456c-a5c7-c3cec8bc7e95 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "POST /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668/action" status: 202 len: 0 microversion: 2.20 time: 0.301812 Jul 04 10:13:50.568528 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 301/606] 10.222.0.79 () {62 vars in 1318 bytes} [Mon Jul 4 10:13:50 2022] POST /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 04 10:13:50.574234 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-99cbdf54-b3e4-4015-be6e-1a0a061ac4aa tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:50.574921 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-99cbdf54-b3e4-4015-be6e-1a0a061ac4aa tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:50.581964 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-99cbdf54-b3e4-4015-be6e-1a0a061ac4aa tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:50.582485 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-99cbdf54-b3e4-4015-be6e-1a0a061ac4aa tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:50.583355 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-99cbdf54-b3e4-4015-be6e-1a0a061ac4aa tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:50.583914 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-99cbdf54-b3e4-4015-be6e-1a0a061ac4aa tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:51.094367 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-99cbdf54-b3e4-4015-be6e-1a0a061ac4aa tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:51.102723 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-99cbdf54-b3e4-4015-be6e-1a0a061ac4aa tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:51.104653 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-99cbdf54-b3e4-4015-be6e-1a0a061ac4aa tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:51.105881 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-99cbdf54-b3e4-4015-be6e-1a0a061ac4aa tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1721 microversion: 2.20 time: 0.535927 Jul 04 10:13:51.117354 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 306/607] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:13:50 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1721 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:13:51.313220 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-bc1039bb-aa57-4292-b1b6-944941a32cfb tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:51.314499 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-bc1039bb-aa57-4292-b1b6-944941a32cfb tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:51.321215 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-bc1039bb-aa57-4292-b1b6-944941a32cfb tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:51.321713 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-bc1039bb-aa57-4292-b1b6-944941a32cfb tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:51.322542 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-bc1039bb-aa57-4292-b1b6-944941a32cfb tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:51.322966 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-bc1039bb-aa57-4292-b1b6-944941a32cfb tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:51.529323 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-3a15454d-090e-4e44-86e1-335a409b714c tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:51.529935 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-3a15454d-090e-4e44-86e1-335a409b714c tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a16e6a2a-ad39-4e14-9cee-083afb6e9745] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:51.537008 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3a15454d-090e-4e44-86e1-335a409b714c tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:51.537454 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3a15454d-090e-4e44-86e1-335a409b714c tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:51.538270 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3a15454d-090e-4e44-86e1-335a409b714c tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:51.538753 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3a15454d-090e-4e44-86e1-335a409b714c tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:51.618130 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-bc1039bb-aa57-4292-b1b6-944941a32cfb tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9c26318d6c41f6b9455153f0d0e55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f101e48ae9b4936a6d1b7bae000d7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:51.626331 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-bc1039bb-aa57-4292-b1b6-944941a32cfb tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120" status: 200 len: 1521 microversion: 2.1 time: 0.317967 Jul 04 10:13:51.627113 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 302/608] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:51 2022] GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120 => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:51.833158 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-3a15454d-090e-4e44-86e1-335a409b714c tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:51.843998 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-3a15454d-090e-4e44-86e1-335a409b714c tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745" status: 200 len: 1366 microversion: 2.1 time: 0.318850 Jul 04 10:13:51.844960 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 307/609] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:51 2022] GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745 => generated 1366 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:51.956727 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-c9811a15-110c-4d6f-9965-1a71385fc0cd req-13d9ef28-6ba3-4b65-ad71-4f2ac06b2532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "068a560b-f200-4046-a36b-7ef23cea5120", "name": "network-vif-deleted", "tag": "037993de-7a0b-470c-95e5-54eeb6c77200"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:13:51.966771 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-c9811a15-110c-4d6f-9965-1a71385fc0cd req-13d9ef28-6ba3-4b65-ad71-4f2ac06b2532 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:51.967473 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-c9811a15-110c-4d6f-9965-1a71385fc0cd req-13d9ef28-6ba3-4b65-ad71-4f2ac06b2532 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:51.979352 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-c9811a15-110c-4d6f-9965-1a71385fc0cd req-13d9ef28-6ba3-4b65-ad71-4f2ac06b2532 service nova] Creating event network-vif-deleted:037993de-7a0b-470c-95e5-54eeb6c77200 for instance 068a560b-f200-4046-a36b-7ef23cea5120 on hv-cinder-84841 Jul 04 10:13:51.985723 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-c9811a15-110c-4d6f-9965-1a71385fc0cd req-13d9ef28-6ba3-4b65-ad71-4f2ac06b2532 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032623 Jul 04 10:13:51.986727 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 303/610] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:13:52.124856 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-4d12d4b0-601d-4128-9b28-db692d52a137 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:52.125613 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-4d12d4b0-601d-4128-9b28-db692d52a137 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:52.131987 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4d12d4b0-601d-4128-9b28-db692d52a137 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:52.132509 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4d12d4b0-601d-4128-9b28-db692d52a137 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:52.133339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4d12d4b0-601d-4128-9b28-db692d52a137 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:52.133872 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4d12d4b0-601d-4128-9b28-db692d52a137 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:52.276078 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-4d12d4b0-601d-4128-9b28-db692d52a137 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:52.284559 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-4d12d4b0-601d-4128-9b28-db692d52a137 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:52.286087 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-4d12d4b0-601d-4128-9b28-db692d52a137 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:52.287522 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-4d12d4b0-601d-4128-9b28-db692d52a137 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1721 microversion: 2.20 time: 0.166773 Jul 04 10:13:52.288077 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 308/611] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:13:52 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:13:52.645564 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-3203fdf3-180d-4168-8bf6-3cf4fab75676 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:52.646456 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-3203fdf3-180d-4168-8bf6-3cf4fab75676 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] [instance: 068a560b-f200-4046-a36b-7ef23cea5120] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:52.653540 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3203fdf3-180d-4168-8bf6-3cf4fab75676 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:52.654051 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3203fdf3-180d-4168-8bf6-3cf4fab75676 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:52.654828 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3203fdf3-180d-4168-8bf6-3cf4fab75676 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:52.655524 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3203fdf3-180d-4168-8bf6-3cf4fab75676 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:52.669579 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.wsgi [None req-3203fdf3-180d-4168-8bf6-3cf4fab75676 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] HTTP exception thrown: Instance 068a560b-f200-4046-a36b-7ef23cea5120 could not be found. Jul 04 10:13:52.671554 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-3203fdf3-180d-4168-8bf6-3cf4fab75676 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Request method failure captured: Jul 04 10:13:52.671554 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: request: GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120 HTTP/1.1 Jul 04 10:13:52.671554 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept: application/json Jul 04 10:13:52.671554 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept-Encoding: identity Jul 04 10:13:52.671554 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Connection: close Jul 04 10:13:52.671554 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Length: 0 Jul 04 10:13:52.671554 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Type: application/json Jul 04 10:13:52.671554 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Host: 10.222.0.79 Jul 04 10:13:52.671554 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Openstack-System-Scope: None Jul 04 10:13:52.671554 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: User-Agent: python-urllib3/1.26.9 Jul 04 10:13:52.671554 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Auth-Token: gAAAAABiwrwoMkd-FZrLDL5-aiRWEi2tqP5Y9aVcYuzksosW1VeQBqKJ-M1OWBbervr9826WxI3yk8EyOa512EHvhSat68LXFU2P2jP3EEjFTBdF0aQwIXnaeXxxjkpaGKt1qebXvZBxiG3u8qxwquzbjrAQDdrYWk79BjtmAHI2EEpansDRzwg Jul 04 10:13:52.671554 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Id: None Jul 04 10:13:52.671554 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Name: None Jul 04 10:13:52.671554 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Identity-Status: Confirmed Jul 04 10:13:52.671554 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Is-Admin-Project: True Jul 04 10:13:52.671554 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Id: default Jul 04 10:13:52.671554 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Name: Default Jul 04 10:13:52.671554 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Id: 7f101e48ae9b4936a6d1b7bae000d7e1 Jul 04 10:13:52.671554 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1112364786 Jul 04 10:13:52.671554 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Role: reader,member Jul 04 10:13:52.671554 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Roles: reader,member Jul 04 10:13:52.673134 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7f101e48ae9b4936a6d1b7bae000d7e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7f101e48ae9b4936a6d1b7bae000d7e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7f101e48ae9b4936a6d1b7bae000d7e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7f101e48ae9b4936a6d1b7bae000d7e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:13:52.673134 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1112364786 Jul 04 10:13:52.673134 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Id: 7f101e48ae9b4936a6d1b7bae000d7e1 Jul 04 10:13:52.673134 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1112364786 Jul 04 10:13:52.673134 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User: tempest-ServerRescueNegativeTestJSON-1112364786-project Jul 04 10:13:52.673134 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Id: default Jul 04 10:13:52.673134 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Name: Default Jul 04 10:13:52.673134 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Id: fc9c26318d6c41f6b9455153f0d0e55b Jul 04 10:13:52.673134 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1112364786-project Jul 04 10:13:52.673134 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: method: > Jul 04 10:13:52.673134 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: exception: Instance 068a560b-f200-4046-a36b-7ef23cea5120 could not be found. Jul 04 10:13:52.673134 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: action_args: {'id': '068a560b-f200-4046-a36b-7ef23cea5120'} Jul 04 10:13:52.674011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:13:52.674011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:13:52.674011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:13:52.674011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:13:52.674011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:13:52.674011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:13:52.674011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:13:52.674011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:13:52.674011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:13:52.674011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:13:52.674011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 068a560b-f200-4046-a36b-7ef23cea5120 could not be found. Jul 04 10:13:52.674011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:13:52.674011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:13:52.674011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:13:52.674011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:13:52.674011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:13:52.674011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:13:52.674011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:13:52.674011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:13:52.674011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:13:52.675185 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:13:52.675185 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 10:13:52.675185 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 10:13:52.675185 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:13:52.675185 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:13:52.675185 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:13:52.675185 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:13:52.675185 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 068a560b-f200-4046-a36b-7ef23cea5120 could not be found. Jul 04 10:13:52.675185 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:13:52.675185 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:13:52.675185 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:13:52.675185 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:13:52.675185 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:13:52.675185 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:13:52.675185 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:13:52.675185 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:13:52.675185 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 068a560b-f200-4046-a36b-7ef23cea5120 could not be found. Jul 04 10:13:52.675185 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:13:52.676270 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-3203fdf3-180d-4168-8bf6-3cf4fab75676 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] Returning 404 to user: Instance 068a560b-f200-4046-a36b-7ef23cea5120 could not be found. {{(pid=117866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:13:52.676270 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-3203fdf3-180d-4168-8bf6-3cf4fab75676 tempest-ServerRescueNegativeTestJSON-1112364786 tempest-ServerRescueNegativeTestJSON-1112364786-project] 10.222.0.79 "GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120" status: 404 len: 111 microversion: 2.1 time: 0.032098 Jul 04 10:13:52.676270 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 304/612] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:52 2022] GET /compute/v2.1/servers/068a560b-f200-4046-a36b-7ef23cea5120 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:13:52.860915 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-94328157-554e-4d5e-a4b8-76fd2f6c22a1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:52.861463 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-94328157-554e-4d5e-a4b8-76fd2f6c22a1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a16e6a2a-ad39-4e14-9cee-083afb6e9745] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:52.868341 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-94328157-554e-4d5e-a4b8-76fd2f6c22a1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:52.868893 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-94328157-554e-4d5e-a4b8-76fd2f6c22a1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:52.869694 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-94328157-554e-4d5e-a4b8-76fd2f6c22a1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:52.870126 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-94328157-554e-4d5e-a4b8-76fd2f6c22a1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:53.004114 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-94328157-554e-4d5e-a4b8-76fd2f6c22a1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:53.011666 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-94328157-554e-4d5e-a4b8-76fd2f6c22a1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745" status: 200 len: 1366 microversion: 2.1 time: 0.154934 Jul 04 10:13:53.012355 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 309/613] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:52 2022] GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:53.306969 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-a2b72f48-5b34-461a-8dd0-e90a3f557f66 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:53.307692 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-a2b72f48-5b34-461a-8dd0-e90a3f557f66 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:53.314380 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a2b72f48-5b34-461a-8dd0-e90a3f557f66 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:53.314849 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a2b72f48-5b34-461a-8dd0-e90a3f557f66 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:53.315616 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a2b72f48-5b34-461a-8dd0-e90a3f557f66 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:53.316076 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a2b72f48-5b34-461a-8dd0-e90a3f557f66 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:53.452693 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-a2b72f48-5b34-461a-8dd0-e90a3f557f66 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:53.460992 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-a2b72f48-5b34-461a-8dd0-e90a3f557f66 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:53.462577 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-a2b72f48-5b34-461a-8dd0-e90a3f557f66 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:53.463782 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-a2b72f48-5b34-461a-8dd0-e90a3f557f66 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1721 microversion: 2.20 time: 0.160916 Jul 04 10:13:53.464311 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 305/614] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:13:53 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:13:54.006823 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-109fe888-2486-4d8f-aa77-0c1e62702651 req-0e20f901-8c0a-45df-813f-d8bcca7965d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a16e6a2a-ad39-4e14-9cee-083afb6e9745", "tag": "346feb22-2463-46f6-a88c-27348c0b1dcf"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:13:54.015387 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-109fe888-2486-4d8f-aa77-0c1e62702651 req-0e20f901-8c0a-45df-813f-d8bcca7965d0 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:54.015850 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-109fe888-2486-4d8f-aa77-0c1e62702651 req-0e20f901-8c0a-45df-813f-d8bcca7965d0 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:54.027546 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-109fe888-2486-4d8f-aa77-0c1e62702651 req-0e20f901-8c0a-45df-813f-d8bcca7965d0 service nova] Creating event network-changed:346feb22-2463-46f6-a88c-27348c0b1dcf for instance a16e6a2a-ad39-4e14-9cee-083afb6e9745 on hv-cinder-84841 Jul 04 10:13:54.029036 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-659ac263-157e-43a3-8fb8-32f982c482a2 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:54.029758 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-659ac263-157e-43a3-8fb8-32f982c482a2 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a16e6a2a-ad39-4e14-9cee-083afb6e9745] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:54.032595 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-109fe888-2486-4d8f-aa77-0c1e62702651 req-0e20f901-8c0a-45df-813f-d8bcca7965d0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029676 Jul 04 10:13:54.033444 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 310/615] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:13:54.038224 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-659ac263-157e-43a3-8fb8-32f982c482a2 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:54.038742 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-659ac263-157e-43a3-8fb8-32f982c482a2 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:54.039648 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-659ac263-157e-43a3-8fb8-32f982c482a2 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:54.040145 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-659ac263-157e-43a3-8fb8-32f982c482a2 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:54.258207 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-659ac263-157e-43a3-8fb8-32f982c482a2 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:54.270023 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-659ac263-157e-43a3-8fb8-32f982c482a2 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745" status: 200 len: 1366 microversion: 2.1 time: 0.245270 Jul 04 10:13:54.274610 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 306/616] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:54 2022] GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:54.485338 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-6f7499c0-474a-4dc4-bc4b-a1a7cad151da tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:54.489302 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-6f7499c0-474a-4dc4-bc4b-a1a7cad151da tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:54.510865 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6f7499c0-474a-4dc4-bc4b-a1a7cad151da tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:54.514049 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6f7499c0-474a-4dc4-bc4b-a1a7cad151da tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:54.515640 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6f7499c0-474a-4dc4-bc4b-a1a7cad151da tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:54.517376 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6f7499c0-474a-4dc4-bc4b-a1a7cad151da tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:54.744825 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-6f7499c0-474a-4dc4-bc4b-a1a7cad151da tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:54.765830 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-6f7499c0-474a-4dc4-bc4b-a1a7cad151da tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:54.767406 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-6f7499c0-474a-4dc4-bc4b-a1a7cad151da tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:54.768974 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-6f7499c0-474a-4dc4-bc4b-a1a7cad151da tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1721 microversion: 2.20 time: 0.290049 Jul 04 10:13:54.769576 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 311/617] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:13:54 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1721 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:13:55.287910 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-99fc4657-7306-47a7-a862-c5809ef1c164 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:55.288462 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-99fc4657-7306-47a7-a862-c5809ef1c164 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a16e6a2a-ad39-4e14-9cee-083afb6e9745] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:55.295201 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-99fc4657-7306-47a7-a862-c5809ef1c164 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:55.295629 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-99fc4657-7306-47a7-a862-c5809ef1c164 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:55.296434 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-99fc4657-7306-47a7-a862-c5809ef1c164 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:55.296795 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-99fc4657-7306-47a7-a862-c5809ef1c164 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:55.435872 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-99fc4657-7306-47a7-a862-c5809ef1c164 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:55.444112 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-99fc4657-7306-47a7-a862-c5809ef1c164 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745" status: 200 len: 1366 microversion: 2.1 time: 0.160033 Jul 04 10:13:55.444664 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 307/618] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:55 2022] GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:13:55.787522 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-630dba28-ab9b-488d-a99d-2fba7044612a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:55.789554 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-630dba28-ab9b-488d-a99d-2fba7044612a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:55.798355 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:13:55.799921 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=10 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:13:55.802392 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-630dba28-ab9b-488d-a99d-2fba7044612a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:55.802743 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-630dba28-ab9b-488d-a99d-2fba7044612a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:55.803772 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-630dba28-ab9b-488d-a99d-2fba7044612a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:55.804399 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-630dba28-ab9b-488d-a99d-2fba7044612a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:56.049535 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-630dba28-ab9b-488d-a99d-2fba7044612a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:56.062757 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-630dba28-ab9b-488d-a99d-2fba7044612a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:56.064267 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-630dba28-ab9b-488d-a99d-2fba7044612a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:56.065535 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-630dba28-ab9b-488d-a99d-2fba7044612a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1721 microversion: 2.20 time: 0.281970 Jul 04 10:13:56.066822 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 312/619] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:13:55 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1721 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:13:56.460400 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-8a2669ee-b158-4937-9b86-275f188b0ae8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:56.461182 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-8a2669ee-b158-4937-9b86-275f188b0ae8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a16e6a2a-ad39-4e14-9cee-083afb6e9745] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:56.463382 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell0:SELECT=2 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:13:56.470739 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8a2669ee-b158-4937-9b86-275f188b0ae8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:56.471207 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8a2669ee-b158-4937-9b86-275f188b0ae8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:56.472094 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8a2669ee-b158-4937-9b86-275f188b0ae8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:56.472699 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8a2669ee-b158-4937-9b86-275f188b0ae8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:56.631416 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-8a2669ee-b158-4937-9b86-275f188b0ae8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:56.639551 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-8a2669ee-b158-4937-9b86-275f188b0ae8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745" status: 200 len: 1366 microversion: 2.1 time: 0.183067 Jul 04 10:13:56.648987 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 308/620] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:56 2022] GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:56.671384 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-27a2a72a-837a-4b0f-8e42-c62a93846214 req-5de1d364-435a-4cab-b2ec-fe637ca70e30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a16e6a2a-ad39-4e14-9cee-083afb6e9745", "name": "network-vif-plugged", "status": "completed", "tag": "346feb22-2463-46f6-a88c-27348c0b1dcf"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:13:56.679829 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-27a2a72a-837a-4b0f-8e42-c62a93846214 req-5de1d364-435a-4cab-b2ec-fe637ca70e30 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:56.680378 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-27a2a72a-837a-4b0f-8e42-c62a93846214 req-5de1d364-435a-4cab-b2ec-fe637ca70e30 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:56.700902 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-27a2a72a-837a-4b0f-8e42-c62a93846214 req-5de1d364-435a-4cab-b2ec-fe637ca70e30 service nova] Creating event network-vif-plugged:346feb22-2463-46f6-a88c-27348c0b1dcf for instance a16e6a2a-ad39-4e14-9cee-083afb6e9745 on hv-cinder-84841 Jul 04 10:13:56.706619 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-27a2a72a-837a-4b0f-8e42-c62a93846214 req-5de1d364-435a-4cab-b2ec-fe637ca70e30 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039067 Jul 04 10:13:56.707625 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 313/621] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:13:57.084867 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-2a2fa51e-4be6-42cd-a8d5-528893f28902 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:57.085437 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-2a2fa51e-4be6-42cd-a8d5-528893f28902 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:57.092133 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2a2fa51e-4be6-42cd-a8d5-528893f28902 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:57.092566 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2a2fa51e-4be6-42cd-a8d5-528893f28902 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:57.093322 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2a2fa51e-4be6-42cd-a8d5-528893f28902 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:57.093807 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2a2fa51e-4be6-42cd-a8d5-528893f28902 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:57.232506 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-2a2fa51e-4be6-42cd-a8d5-528893f28902 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:57.240515 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-2a2fa51e-4be6-42cd-a8d5-528893f28902 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:57.241994 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-2a2fa51e-4be6-42cd-a8d5-528893f28902 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:57.243148 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-2a2fa51e-4be6-42cd-a8d5-528893f28902 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1721 microversion: 2.20 time: 0.162756 Jul 04 10:13:57.243700 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 309/622] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:13:57 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:13:57.657787 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-630aec54-d5e1-4f1a-9683-87eca3a8facb tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:57.658479 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-630aec54-d5e1-4f1a-9683-87eca3a8facb tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a16e6a2a-ad39-4e14-9cee-083afb6e9745] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:57.664708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-630aec54-d5e1-4f1a-9683-87eca3a8facb tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:57.665174 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-630aec54-d5e1-4f1a-9683-87eca3a8facb tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:57.666001 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-630aec54-d5e1-4f1a-9683-87eca3a8facb tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:57.666419 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-630aec54-d5e1-4f1a-9683-87eca3a8facb tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:57.800451 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-630aec54-d5e1-4f1a-9683-87eca3a8facb tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:57.809797 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-630aec54-d5e1-4f1a-9683-87eca3a8facb tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745" status: 200 len: 1366 microversion: 2.1 time: 0.156839 Jul 04 10:13:57.810558 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 314/623] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:57 2022] GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:58.264765 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-d3a66247-693e-442d-a8b6-697183ab1b36 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:58.265572 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-d3a66247-693e-442d-a8b6-697183ab1b36 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:58.274175 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d3a66247-693e-442d-a8b6-697183ab1b36 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:58.274733 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d3a66247-693e-442d-a8b6-697183ab1b36 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:58.275929 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d3a66247-693e-442d-a8b6-697183ab1b36 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:58.276462 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d3a66247-693e-442d-a8b6-697183ab1b36 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:58.414859 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-d3a66247-693e-442d-a8b6-697183ab1b36 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:58.423457 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-d3a66247-693e-442d-a8b6-697183ab1b36 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:58.424947 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-d3a66247-693e-442d-a8b6-697183ab1b36 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:58.426177 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-d3a66247-693e-442d-a8b6-697183ab1b36 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1721 microversion: 2.20 time: 0.167067 Jul 04 10:13:58.426823 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 310/624] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:13:58 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:13:58.628277 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-fd3d533d-7582-4f82-9b11-3d20b3fd6c0d tempest-VolumesTestJSON-441379211 tempest-VolumesTestJSON-441379211-project] Calling method '.version_select at 0x7f2802ff3700>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:58.675521 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-fd3d533d-7582-4f82-9b11-3d20b3fd6c0d tempest-VolumesTestJSON-441379211 tempest-VolumesTestJSON-441379211-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/747e8c81-2654-48df-8d8a-767cd4f10e89" status: 200 len: 351 microversion: 2.1 time: 0.051113 Jul 04 10:13:58.677704 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 315/625] 10.222.0.79 () {58 vars in 1244 bytes} [Mon Jul 4 10:13:58 2022] GET /compute/v2.1/os-volumes/747e8c81-2654-48df-8d8a-767cd4f10e89 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:13:58.827396 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-9f9dcd45-039a-4681-a9ff-0f7fa43a78b6 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:58.828030 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-9f9dcd45-039a-4681-a9ff-0f7fa43a78b6 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a16e6a2a-ad39-4e14-9cee-083afb6e9745] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:58.834498 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9f9dcd45-039a-4681-a9ff-0f7fa43a78b6 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:58.834948 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9f9dcd45-039a-4681-a9ff-0f7fa43a78b6 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:58.835713 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9f9dcd45-039a-4681-a9ff-0f7fa43a78b6 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:58.836146 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9f9dcd45-039a-4681-a9ff-0f7fa43a78b6 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:58.975675 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-9f9dcd45-039a-4681-a9ff-0f7fa43a78b6 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:58.983384 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-9f9dcd45-039a-4681-a9ff-0f7fa43a78b6 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745" status: 200 len: 1555 microversion: 2.1 time: 0.159948 Jul 04 10:13:58.983958 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 311/626] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:13:58 2022] GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:13:58.999992 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-1c77d888-446b-44b1-a8c7-cb6045b2d77a tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:59.000470 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-1c77d888-446b-44b1-a8c7-cb6045b2d77a tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a16e6a2a-ad39-4e14-9cee-083afb6e9745] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:59.006617 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1c77d888-446b-44b1-a8c7-cb6045b2d77a tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:59.007052 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1c77d888-446b-44b1-a8c7-cb6045b2d77a tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:59.007806 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1c77d888-446b-44b1-a8c7-cb6045b2d77a tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:59.008230 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1c77d888-446b-44b1-a8c7-cb6045b2d77a tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:59.089007 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-1c77d888-446b-44b1-a8c7-cb6045b2d77a tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092712 Jul 04 10:13:59.090191 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 316/627] 10.222.0.79 () {58 vars in 1274 bytes} [Mon Jul 4 10:13:58 2022] GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:13:59.444604 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-3c23dd3b-5d0d-49eb-9423-03775f50cd8c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:13:59.445202 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-3c23dd3b-5d0d-49eb-9423-03775f50cd8c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:13:59.452225 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3c23dd3b-5d0d-49eb-9423-03775f50cd8c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:59.452664 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3c23dd3b-5d0d-49eb-9423-03775f50cd8c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:59.453413 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3c23dd3b-5d0d-49eb-9423-03775f50cd8c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:13:59.453868 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3c23dd3b-5d0d-49eb-9423-03775f50cd8c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:13:59.587424 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-3c23dd3b-5d0d-49eb-9423-03775f50cd8c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:59.596007 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-3c23dd3b-5d0d-49eb-9423-03775f50cd8c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:59.597491 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-3c23dd3b-5d0d-49eb-9423-03775f50cd8c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:13:59.598680 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-3c23dd3b-5d0d-49eb-9423-03775f50cd8c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1721 microversion: 2.20 time: 0.158094 Jul 04 10:13:59.599259 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 312/628] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:13:59 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:14:00.019821 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-fed3d1ba-25c0-4f3d-995c-85f4c9ed25d6 tempest-VolumesTestJSON-441379211 tempest-VolumesTestJSON-441379211-project] Calling method '.version_select at 0x7f2802f58dc0>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:00.033133 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-99b475b7-a91e-47ac-9ef8-33c500099aa2 req-28f59965-869c-4a30-9764-6c9cbc90b93d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a16e6a2a-ad39-4e14-9cee-083afb6e9745", "tag": "346feb22-2463-46f6-a88c-27348c0b1dcf"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:14:00.041528 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-99b475b7-a91e-47ac-9ef8-33c500099aa2 req-28f59965-869c-4a30-9764-6c9cbc90b93d service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:00.042243 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-99b475b7-a91e-47ac-9ef8-33c500099aa2 req-28f59965-869c-4a30-9764-6c9cbc90b93d service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:00.046253 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:14:00.057633 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-99b475b7-a91e-47ac-9ef8-33c500099aa2 req-28f59965-869c-4a30-9764-6c9cbc90b93d service nova] Creating event network-changed:346feb22-2463-46f6-a88c-27348c0b1dcf for instance a16e6a2a-ad39-4e14-9cee-083afb6e9745 on hv-cinder-84841 Jul 04 10:14:00.063671 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-99b475b7-a91e-47ac-9ef8-33c500099aa2 req-28f59965-869c-4a30-9764-6c9cbc90b93d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034542 Jul 04 10:14:00.064463 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 313/629] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:14:00.071173 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-fed3d1ba-25c0-4f3d-995c-85f4c9ed25d6 tempest-VolumesTestJSON-441379211 tempest-VolumesTestJSON-441379211-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/7326bb3a-3076-41a4-87f9-1fc426868694" status: 200 len: 351 microversion: 2.1 time: 0.055711 Jul 04 10:14:00.071819 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 317/630] 10.222.0.79 () {58 vars in 1244 bytes} [Mon Jul 4 10:14:00 2022] GET /compute/v2.1/os-volumes/7326bb3a-3076-41a4-87f9-1fc426868694 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:14:00.617777 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-3e719c6b-e5e1-4f43-a6ac-e867a280650a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:00.618470 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-3e719c6b-e5e1-4f43-a6ac-e867a280650a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:00.626111 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3e719c6b-e5e1-4f43-a6ac-e867a280650a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:00.626612 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3e719c6b-e5e1-4f43-a6ac-e867a280650a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:00.627399 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3e719c6b-e5e1-4f43-a6ac-e867a280650a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:00.627833 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3e719c6b-e5e1-4f43-a6ac-e867a280650a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:00.772836 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-3e719c6b-e5e1-4f43-a6ac-e867a280650a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:00.781955 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-3e719c6b-e5e1-4f43-a6ac-e867a280650a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:00.783684 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-3e719c6b-e5e1-4f43-a6ac-e867a280650a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:00.785047 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-3e719c6b-e5e1-4f43-a6ac-e867a280650a tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1721 microversion: 2.20 time: 0.172149 Jul 04 10:14:00.786135 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 314/631] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:14:00 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:14:01.442364 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-10d0be44-a0dc-44c9-bf0a-66128a399747 tempest-VolumesTestJSON-441379211 tempest-VolumesTestJSON-441379211-project] Calling method '.version_select at 0x7f2802ec1c10>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:01.490715 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-10d0be44-a0dc-44c9-bf0a-66128a399747 tempest-VolumesTestJSON-441379211 tempest-VolumesTestJSON-441379211-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/70101426-4177-4578-bb26-75ec2cc4402a" status: 200 len: 351 microversion: 2.1 time: 0.052691 Jul 04 10:14:01.491263 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 318/632] 10.222.0.79 () {58 vars in 1244 bytes} [Mon Jul 4 10:14:01 2022] GET /compute/v2.1/os-volumes/70101426-4177-4578-bb26-75ec2cc4402a => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:14:01.505875 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-42838dd0-e11b-43d9-bc33-fdc7198321d2 tempest-VolumesTestJSON-441379211 tempest-VolumesTestJSON-441379211-project] Calling method '.version_select at 0x7f2802fc1d30>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:01.601165 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-42838dd0-e11b-43d9-bc33-fdc7198321d2 tempest-VolumesTestJSON-441379211 tempest-VolumesTestJSON-441379211-project] 10.222.0.79 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.101505 Jul 04 10:14:01.601774 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 315/633] 10.222.0.79 () {58 vars in 1133 bytes} [Mon Jul 4 10:14:01 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:01.614269 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-628da099-9380-4ec7-9bcf-875c250cd137 tempest-VolumesTestJSON-441379211 tempest-VolumesTestJSON-441379211-project] Calling method '.version_select at 0x7f2802f3fee0>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:01.695670 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-628da099-9380-4ec7-9bcf-875c250cd137 tempest-VolumesTestJSON-441379211 tempest-VolumesTestJSON-441379211-project] 10.222.0.79 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.085207 Jul 04 10:14:01.696243 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 319/634] 10.222.0.79 () {58 vars in 1148 bytes} [Mon Jul 4 10:14:01 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:14:01.711631 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-fe6dd80d-b90e-4da3-8b7b-bba70ec3adb0 tempest-VolumesTestJSON-441379211 tempest-VolumesTestJSON-441379211-project] Calling method '.version_select at 0x7f2802fca700>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:01.792325 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-fe6dd80d-b90e-4da3-8b7b-bba70ec3adb0 tempest-VolumesTestJSON-441379211 tempest-VolumesTestJSON-441379211-project] 10.222.0.79 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.087338 Jul 04 10:14:01.792895 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 316/635] 10.222.0.79 () {58 vars in 1133 bytes} [Mon Jul 4 10:14:01 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:01.803115 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-4df7ca3c-d88b-4754-9c00-c49111b213cd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:01.803738 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-4df7ca3c-d88b-4754-9c00-c49111b213cd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:01.805051 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-83b39707-896e-4d80-8cca-84af48558e41 tempest-VolumesTestJSON-441379211 tempest-VolumesTestJSON-441379211-project] Calling method '.version_select at 0x7f2802fda940>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:01.811282 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4df7ca3c-d88b-4754-9c00-c49111b213cd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:01.811965 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4df7ca3c-d88b-4754-9c00-c49111b213cd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:01.812749 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4df7ca3c-d88b-4754-9c00-c49111b213cd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:01.813181 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4df7ca3c-d88b-4754-9c00-c49111b213cd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:01.891172 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-83b39707-896e-4d80-8cca-84af48558e41 tempest-VolumesTestJSON-441379211 tempest-VolumesTestJSON-441379211-project] 10.222.0.79 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089677 Jul 04 10:14:01.891747 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 317/636] 10.222.0.79 () {58 vars in 1166 bytes} [Mon Jul 4 10:14:01 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:14:01.903300 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-16e61118-64d5-4689-9cf5-91fe370da420 tempest-VolumesTestJSON-441379211 tempest-VolumesTestJSON-441379211-project] Calling method '.version_select at 0x7f2802fda3a0>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:01.953425 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-4df7ca3c-d88b-4754-9c00-c49111b213cd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:01.961452 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-4df7ca3c-d88b-4754-9c00-c49111b213cd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:01.962982 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-4df7ca3c-d88b-4754-9c00-c49111b213cd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:01.964132 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-4df7ca3c-d88b-4754-9c00-c49111b213cd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1742 microversion: 2.20 time: 0.165026 Jul 04 10:14:01.964660 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 320/637] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:14:01 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1742 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:14:01.984416 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-16e61118-64d5-4689-9cf5-91fe370da420 tempest-VolumesTestJSON-441379211 tempest-VolumesTestJSON-441379211-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.084973 Jul 04 10:14:01.984994 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 318/638] 10.222.0.79 () {58 vars in 1169 bytes} [Mon Jul 4 10:14:01 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 10:14:01.997094 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-4ff43f16-09fd-41ff-b75f-943d20d76c12 tempest-VolumesTestJSON-441379211 tempest-VolumesTestJSON-441379211-project] Calling method '.version_select at 0x7f2802ec1ee0>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:02.080980 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-4ff43f16-09fd-41ff-b75f-943d20d76c12 tempest-VolumesTestJSON-441379211 tempest-VolumesTestJSON-441379211-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.087350 Jul 04 10:14:02.081838 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 321/639] 10.222.0.79 () {58 vars in 1154 bytes} [Mon Jul 4 10:14:01 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:02.099871 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-82f2f612-833e-4243-9101-74cf77769299 tempest-VolumesTestJSON-441379211 tempest-VolumesTestJSON-441379211-project] Calling method '.version_select at 0x7f2802fca820>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:02.187095 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-82f2f612-833e-4243-9101-74cf77769299 tempest-VolumesTestJSON-441379211 tempest-VolumesTestJSON-441379211-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.093411 Jul 04 10:14:02.187758 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 319/640] 10.222.0.79 () {58 vars in 1187 bytes} [Mon Jul 4 10:14:02 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:14:02.199876 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-848d0998-3fd7-43c1-955c-0f34f51cbc22 tempest-VolumesTestJSON-441379211 tempest-VolumesTestJSON-441379211-project] Calling method '.version_select at 0x7f2802f2f430>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:02.281795 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-848d0998-3fd7-43c1-955c-0f34f51cbc22 tempest-VolumesTestJSON-441379211 tempest-VolumesTestJSON-441379211-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.086004 Jul 04 10:14:02.282372 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 322/641] 10.222.0.79 () {58 vars in 1154 bytes} [Mon Jul 4 10:14:02 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:02.984608 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-f0a626a3-9d3d-4be9-bbd4-30f00654f7f0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:02.985175 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-f0a626a3-9d3d-4be9-bbd4-30f00654f7f0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:02.991875 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f0a626a3-9d3d-4be9-bbd4-30f00654f7f0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:02.992309 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f0a626a3-9d3d-4be9-bbd4-30f00654f7f0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:02.993054 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f0a626a3-9d3d-4be9-bbd4-30f00654f7f0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:02.993472 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f0a626a3-9d3d-4be9-bbd4-30f00654f7f0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:03.128110 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-f0a626a3-9d3d-4be9-bbd4-30f00654f7f0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:03.136780 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-f0a626a3-9d3d-4be9-bbd4-30f00654f7f0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:03.138308 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-f0a626a3-9d3d-4be9-bbd4-30f00654f7f0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:03.139485 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-f0a626a3-9d3d-4be9-bbd4-30f00654f7f0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1742 microversion: 2.20 time: 0.159398 Jul 04 10:14:03.140041 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 320/642] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:14:02 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1742 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 10:14:04.157960 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-953c4621-e52f-4b98-ae3d-39cf3dbcd5c3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:04.158528 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-953c4621-e52f-4b98-ae3d-39cf3dbcd5c3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:04.165602 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-953c4621-e52f-4b98-ae3d-39cf3dbcd5c3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:04.166078 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-953c4621-e52f-4b98-ae3d-39cf3dbcd5c3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:04.166837 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-953c4621-e52f-4b98-ae3d-39cf3dbcd5c3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:04.167620 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-953c4621-e52f-4b98-ae3d-39cf3dbcd5c3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:04.304291 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-953c4621-e52f-4b98-ae3d-39cf3dbcd5c3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:04.313791 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-953c4621-e52f-4b98-ae3d-39cf3dbcd5c3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:04.315382 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-953c4621-e52f-4b98-ae3d-39cf3dbcd5c3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:04.316645 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-953c4621-e52f-4b98-ae3d-39cf3dbcd5c3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1742 microversion: 2.20 time: 0.163169 Jul 04 10:14:04.317202 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 323/643] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:14:04 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1742 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:14:04.716245 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-b6a8b6c2-be68-4b24-8b09-56894a7243a7 req-f38d3443-7153-45e6-bb83-f2b61cd773b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a66cd362-4fe8-499f-850d-6755bd23c668", "name": "network-vif-plugged", "status": "completed", "tag": "4f41751d-4044-46c9-8fe9-0a9fdf5d5a79"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:14:04.727223 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-b6a8b6c2-be68-4b24-8b09-56894a7243a7 req-f38d3443-7153-45e6-bb83-f2b61cd773b0 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:04.727897 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-b6a8b6c2-be68-4b24-8b09-56894a7243a7 req-f38d3443-7153-45e6-bb83-f2b61cd773b0 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:04.747559 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-b6a8b6c2-be68-4b24-8b09-56894a7243a7 req-f38d3443-7153-45e6-bb83-f2b61cd773b0 service nova] Creating event network-vif-plugged:4f41751d-4044-46c9-8fe9-0a9fdf5d5a79 for instance a66cd362-4fe8-499f-850d-6755bd23c668 on hv-cinder-84841 Jul 04 10:14:04.754081 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-b6a8b6c2-be68-4b24-8b09-56894a7243a7 req-f38d3443-7153-45e6-bb83-f2b61cd773b0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043231 Jul 04 10:14:04.755911 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 321/644] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:14:05.335374 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-d1c76fad-2792-45cb-8f15-c493e975f4a3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:05.336316 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d1c76fad-2792-45cb-8f15-c493e975f4a3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:05.344235 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d1c76fad-2792-45cb-8f15-c493e975f4a3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:05.344976 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d1c76fad-2792-45cb-8f15-c493e975f4a3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:05.346001 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d1c76fad-2792-45cb-8f15-c493e975f4a3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:05.346519 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d1c76fad-2792-45cb-8f15-c493e975f4a3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:05.499358 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-d1c76fad-2792-45cb-8f15-c493e975f4a3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:05.513980 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-d1c76fad-2792-45cb-8f15-c493e975f4a3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:05.517075 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-d1c76fad-2792-45cb-8f15-c493e975f4a3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:05.518856 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-d1c76fad-2792-45cb-8f15-c493e975f4a3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1737 microversion: 2.20 time: 0.187558 Jul 04 10:14:05.519930 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 324/645] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:14:05 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1737 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:14:06.538754 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-e82b3ece-5045-4443-96ab-0b6473f47fa3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:06.539452 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-e82b3ece-5045-4443-96ab-0b6473f47fa3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:06.548176 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e82b3ece-5045-4443-96ab-0b6473f47fa3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:06.548625 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e82b3ece-5045-4443-96ab-0b6473f47fa3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:06.549398 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e82b3ece-5045-4443-96ab-0b6473f47fa3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:06.550096 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e82b3ece-5045-4443-96ab-0b6473f47fa3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:06.713448 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-e82b3ece-5045-4443-96ab-0b6473f47fa3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:06.724255 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-e82b3ece-5045-4443-96ab-0b6473f47fa3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:06.726322 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-e82b3ece-5045-4443-96ab-0b6473f47fa3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:06.728140 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-e82b3ece-5045-4443-96ab-0b6473f47fa3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1737 microversion: 2.20 time: 0.193358 Jul 04 10:14:06.728983 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 322/646] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:14:06 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1737 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:14:07.746834 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-89e86d1c-eac8-4054-ad25-4c32d5df5098 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:07.748978 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-89e86d1c-eac8-4054-ad25-4c32d5df5098 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:07.755815 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-89e86d1c-eac8-4054-ad25-4c32d5df5098 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:07.756476 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-89e86d1c-eac8-4054-ad25-4c32d5df5098 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:07.757301 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-89e86d1c-eac8-4054-ad25-4c32d5df5098 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:07.757815 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-89e86d1c-eac8-4054-ad25-4c32d5df5098 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:07.911685 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-89e86d1c-eac8-4054-ad25-4c32d5df5098 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:07.928198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-89e86d1c-eac8-4054-ad25-4c32d5df5098 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:07.931252 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-89e86d1c-eac8-4054-ad25-4c32d5df5098 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:07.932455 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-89e86d1c-eac8-4054-ad25-4c32d5df5098 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1737 microversion: 2.20 time: 0.189674 Jul 04 10:14:07.933878 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 325/647] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:14:07 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1737 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:14:08.952992 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-4d08469a-eac4-4821-9295-2c1745c8690e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:08.953601 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-4d08469a-eac4-4821-9295-2c1745c8690e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:08.959994 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-4d08469a-eac4-4821-9295-2c1745c8690e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:08.960673 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-4d08469a-eac4-4821-9295-2c1745c8690e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:08.961632 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-4d08469a-eac4-4821-9295-2c1745c8690e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:08.962219 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-4d08469a-eac4-4821-9295-2c1745c8690e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:09.148848 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-4d08469a-eac4-4821-9295-2c1745c8690e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:09.159754 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-4d08469a-eac4-4821-9295-2c1745c8690e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:09.161741 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-4d08469a-eac4-4821-9295-2c1745c8690e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:09.163391 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-4d08469a-eac4-4821-9295-2c1745c8690e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1737 microversion: 2.20 time: 0.214543 Jul 04 10:14:09.174212 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 323/648] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:14:08 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1737 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:14:10.182845 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-12388fb4-b779-4d59-8f63-9d74ce80b751 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:10.185035 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-12388fb4-b779-4d59-8f63-9d74ce80b751 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:10.192869 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-12388fb4-b779-4d59-8f63-9d74ce80b751 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:10.193641 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-12388fb4-b779-4d59-8f63-9d74ce80b751 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:10.194843 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-12388fb4-b779-4d59-8f63-9d74ce80b751 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:10.195508 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-12388fb4-b779-4d59-8f63-9d74ce80b751 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:10.397021 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-12388fb4-b779-4d59-8f63-9d74ce80b751 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:10.408609 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-12388fb4-b779-4d59-8f63-9d74ce80b751 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:10.410137 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-12388fb4-b779-4d59-8f63-9d74ce80b751 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:10.412371 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-12388fb4-b779-4d59-8f63-9d74ce80b751 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1737 microversion: 2.20 time: 0.234460 Jul 04 10:14:10.427769 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 326/649] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:14:10 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1737 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:14:11.431006 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-53164ba7-b384-4a80-8d5b-02d63a2efebd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:11.432511 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-53164ba7-b384-4a80-8d5b-02d63a2efebd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:11.440272 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-53164ba7-b384-4a80-8d5b-02d63a2efebd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:11.441009 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-53164ba7-b384-4a80-8d5b-02d63a2efebd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:11.442211 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-53164ba7-b384-4a80-8d5b-02d63a2efebd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:11.442879 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-53164ba7-b384-4a80-8d5b-02d63a2efebd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:11.608475 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-53164ba7-b384-4a80-8d5b-02d63a2efebd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:11.621335 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-53164ba7-b384-4a80-8d5b-02d63a2efebd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:11.623433 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-53164ba7-b384-4a80-8d5b-02d63a2efebd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:11.625017 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-53164ba7-b384-4a80-8d5b-02d63a2efebd tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1737 microversion: 2.20 time: 0.197859 Jul 04 10:14:11.626067 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 324/650] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:14:11 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1737 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:14:12.643939 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2ecf0ac3-6456-4a72-bfcb-083a52e1bf49 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:12.644541 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-2ecf0ac3-6456-4a72-bfcb-083a52e1bf49 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:12.652056 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2ecf0ac3-6456-4a72-bfcb-083a52e1bf49 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:12.652919 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2ecf0ac3-6456-4a72-bfcb-083a52e1bf49 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:12.654005 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2ecf0ac3-6456-4a72-bfcb-083a52e1bf49 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:12.654682 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2ecf0ac3-6456-4a72-bfcb-083a52e1bf49 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:12.659694 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=100 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:14:12.833310 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-2ecf0ac3-6456-4a72-bfcb-083a52e1bf49 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:12.842954 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-2ecf0ac3-6456-4a72-bfcb-083a52e1bf49 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:12.844458 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-2ecf0ac3-6456-4a72-bfcb-083a52e1bf49 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:12.845646 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-2ecf0ac3-6456-4a72-bfcb-083a52e1bf49 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1737 microversion: 2.20 time: 0.205734 Jul 04 10:14:12.846702 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 327/651] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:14:12 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1737 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:14:13.864499 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-955b557d-b73d-42f2-ad5f-6ba1db36b2d0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:13.865153 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-955b557d-b73d-42f2-ad5f-6ba1db36b2d0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:13.872050 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-955b557d-b73d-42f2-ad5f-6ba1db36b2d0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:13.872462 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-955b557d-b73d-42f2-ad5f-6ba1db36b2d0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:13.873225 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-955b557d-b73d-42f2-ad5f-6ba1db36b2d0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:13.873799 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-955b557d-b73d-42f2-ad5f-6ba1db36b2d0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:14.032502 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-955b557d-b73d-42f2-ad5f-6ba1db36b2d0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:14.040798 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-955b557d-b73d-42f2-ad5f-6ba1db36b2d0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:14.042732 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-955b557d-b73d-42f2-ad5f-6ba1db36b2d0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:14.043968 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-955b557d-b73d-42f2-ad5f-6ba1db36b2d0 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1737 microversion: 2.20 time: 0.183570 Jul 04 10:14:14.044704 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 325/652] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:14:13 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:14:15.063166 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-63beca39-b3a6-4b32-a490-9928cbaf3d70 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:15.063845 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-63beca39-b3a6-4b32-a490-9928cbaf3d70 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:15.066287 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:14:15.071423 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-63beca39-b3a6-4b32-a490-9928cbaf3d70 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:15.071919 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-63beca39-b3a6-4b32-a490-9928cbaf3d70 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:15.072814 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-63beca39-b3a6-4b32-a490-9928cbaf3d70 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:15.073320 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-63beca39-b3a6-4b32-a490-9928cbaf3d70 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:15.217220 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-63beca39-b3a6-4b32-a490-9928cbaf3d70 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:15.225610 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-63beca39-b3a6-4b32-a490-9928cbaf3d70 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:15.227169 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-63beca39-b3a6-4b32-a490-9928cbaf3d70 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:15.228337 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-63beca39-b3a6-4b32-a490-9928cbaf3d70 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1719 microversion: 2.20 time: 0.169311 Jul 04 10:14:15.228905 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 328/653] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:14:15 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1719 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:14:16.247103 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-d23bcc1d-a34f-43dc-93ed-f46cd155688b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:16.247707 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-d23bcc1d-a34f-43dc-93ed-f46cd155688b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:16.254501 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d23bcc1d-a34f-43dc-93ed-f46cd155688b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:16.254943 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d23bcc1d-a34f-43dc-93ed-f46cd155688b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:16.255699 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d23bcc1d-a34f-43dc-93ed-f46cd155688b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:16.256128 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d23bcc1d-a34f-43dc-93ed-f46cd155688b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:16.393134 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-d23bcc1d-a34f-43dc-93ed-f46cd155688b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:16.403000 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-d23bcc1d-a34f-43dc-93ed-f46cd155688b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:16.404476 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-d23bcc1d-a34f-43dc-93ed-f46cd155688b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:16.405656 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-d23bcc1d-a34f-43dc-93ed-f46cd155688b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1719 microversion: 2.20 time: 0.162552 Jul 04 10:14:16.406217 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 326/654] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:14:16 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:14:16.903047 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-f77e22d8-9508-4af9-83e3-23a1c31e803c req-b73cc45f-264c-44ea-a503-d6f34daa79ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a66cd362-4fe8-499f-850d-6755bd23c668", "name": "network-vif-unplugged", "status": "completed", "tag": "4f41751d-4044-46c9-8fe9-0a9fdf5d5a79"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:14:16.911882 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-f77e22d8-9508-4af9-83e3-23a1c31e803c req-b73cc45f-264c-44ea-a503-d6f34daa79ce service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:16.912248 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-f77e22d8-9508-4af9-83e3-23a1c31e803c req-b73cc45f-264c-44ea-a503-d6f34daa79ce service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:16.923918 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.compute.server_external_events [req-f77e22d8-9508-4af9-83e3-23a1c31e803c req-b73cc45f-264c-44ea-a503-d6f34daa79ce service nova] Unable to find a host for instance a66cd362-4fe8-499f-850d-6755bd23c668. Dropping event network-vif-unplugged {{(pid=117865) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 04 10:14:16.924780 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-f77e22d8-9508-4af9-83e3-23a1c31e803c req-b73cc45f-264c-44ea-a503-d6f34daa79ce service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.157051 Jul 04 10:14:16.925355 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 329/655] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 158 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 04 10:14:17.428772 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-26cfb6f4-a0cf-4d1f-a2ca-189cf5168997 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:17.429953 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-26cfb6f4-a0cf-4d1f-a2ca-189cf5168997 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:17.433560 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_api:SELECT=51 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:14:17.439078 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-26cfb6f4-a0cf-4d1f-a2ca-189cf5168997 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:17.439526 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-26cfb6f4-a0cf-4d1f-a2ca-189cf5168997 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:17.440299 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-26cfb6f4-a0cf-4d1f-a2ca-189cf5168997 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:17.440726 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-26cfb6f4-a0cf-4d1f-a2ca-189cf5168997 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:17.575765 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-26cfb6f4-a0cf-4d1f-a2ca-189cf5168997 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:17.584085 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-26cfb6f4-a0cf-4d1f-a2ca-189cf5168997 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:17.585575 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-26cfb6f4-a0cf-4d1f-a2ca-189cf5168997 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:17.586774 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-26cfb6f4-a0cf-4d1f-a2ca-189cf5168997 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1662 microversion: 2.20 time: 0.164629 Jul 04 10:14:17.587335 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 327/656] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:14:17 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1662 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:14:17.604865 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-6ea96a53-dfb5-4f48-97cb-b458a7677552 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbbc152b-208b-4e42-9a7e-408177853cc3"}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:14:17.605980 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-6ea96a53-dfb5-4f48-97cb-b458a7677552 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:17.612105 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6ea96a53-dfb5-4f48-97cb-b458a7677552 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:17.612556 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6ea96a53-dfb5-4f48-97cb-b458a7677552 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:17.613328 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6ea96a53-dfb5-4f48-97cb-b458a7677552 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:17.613816 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6ea96a53-dfb5-4f48-97cb-b458a7677552 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:17.920488 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-6ea96a53-dfb5-4f48-97cb-b458a7677552 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "POST /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.319551 Jul 04 10:14:17.926161 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 330/657] 10.222.0.79 () {62 vars in 1363 bytes} [Mon Jul 4 10:14:17 2022] POST /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668/os-volume_attachments => generated 188 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 10:14:18.035671 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-46d4e773-371f-4a4e-9da4-4a191e15c1fb tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:18.036164 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-46d4e773-371f-4a4e-9da4-4a191e15c1fb tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:18.042927 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-46d4e773-371f-4a4e-9da4-4a191e15c1fb tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:18.043366 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-46d4e773-371f-4a4e-9da4-4a191e15c1fb tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:18.044133 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-46d4e773-371f-4a4e-9da4-4a191e15c1fb tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:18.044562 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-46d4e773-371f-4a4e-9da4-4a191e15c1fb tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:18.302468 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-46d4e773-371f-4a4e-9da4-4a191e15c1fb tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668/os-volume_attachments/bbbc152b-208b-4e42-9a7e-408177853cc3" status: 202 len: 0 microversion: 2.20 time: 0.270802 Jul 04 10:14:18.303052 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 328/658] 10.222.0.79 () {60 vars in 1456 bytes} [Mon Jul 4 10:14:18 2022] DELETE /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668/os-volume_attachments/bbbc152b-208b-4e42-9a7e-408177853cc3 => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 04 10:14:18.370028 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-85173aaf-4906-43d7-b0c8-6c37e0d7a08e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:14:18.371032 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-85173aaf-4906-43d7-b0c8-6c37e0d7a08e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:18.380302 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-85173aaf-4906-43d7-b0c8-6c37e0d7a08e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:18.380879 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-85173aaf-4906-43d7-b0c8-6c37e0d7a08e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:18.381965 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-85173aaf-4906-43d7-b0c8-6c37e0d7a08e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:18.382508 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-85173aaf-4906-43d7-b0c8-6c37e0d7a08e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:18.471569 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-85173aaf-4906-43d7-b0c8-6c37e0d7a08e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "POST /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668/action" status: 202 len: 0 microversion: 2.20 time: 0.107681 Jul 04 10:14:18.472080 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 331/659] 10.222.0.79 () {62 vars in 1318 bytes} [Mon Jul 4 10:14:18 2022] POST /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 04 10:14:18.480208 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-c60407e8-0d54-46e9-a59a-d343edf698d5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:18.480809 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-c60407e8-0d54-46e9-a59a-d343edf698d5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:18.488052 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c60407e8-0d54-46e9-a59a-d343edf698d5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:18.488496 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c60407e8-0d54-46e9-a59a-d343edf698d5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:18.489260 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c60407e8-0d54-46e9-a59a-d343edf698d5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:18.489711 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c60407e8-0d54-46e9-a59a-d343edf698d5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:18.619877 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-c60407e8-0d54-46e9-a59a-d343edf698d5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:18.628323 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-c60407e8-0d54-46e9-a59a-d343edf698d5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:18.630057 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-c60407e8-0d54-46e9-a59a-d343edf698d5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:18.631210 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-c60407e8-0d54-46e9-a59a-d343edf698d5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1670 microversion: 2.20 time: 0.154974 Jul 04 10:14:18.631754 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 329/660] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:14:18 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:14:19.651147 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-1bfcc0cc-4719-44d4-b308-ecc1d1e67f08 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:19.651917 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-1bfcc0cc-4719-44d4-b308-ecc1d1e67f08 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:19.659215 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1bfcc0cc-4719-44d4-b308-ecc1d1e67f08 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:19.659701 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1bfcc0cc-4719-44d4-b308-ecc1d1e67f08 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:19.660469 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1bfcc0cc-4719-44d4-b308-ecc1d1e67f08 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:19.660900 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1bfcc0cc-4719-44d4-b308-ecc1d1e67f08 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:19.869251 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-1bfcc0cc-4719-44d4-b308-ecc1d1e67f08 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:19.877932 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-1bfcc0cc-4719-44d4-b308-ecc1d1e67f08 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:19.879416 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-1bfcc0cc-4719-44d4-b308-ecc1d1e67f08 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:19.880576 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-1bfcc0cc-4719-44d4-b308-ecc1d1e67f08 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1728 microversion: 2.20 time: 0.234040 Jul 04 10:14:19.881136 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 332/661] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:14:19 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1728 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:14:20.900773 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-0eab998b-4e7b-4920-9178-61fb10ced3f3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:20.901546 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-0eab998b-4e7b-4920-9178-61fb10ced3f3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:20.911992 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0eab998b-4e7b-4920-9178-61fb10ced3f3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:20.915766 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0eab998b-4e7b-4920-9178-61fb10ced3f3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:20.919471 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0eab998b-4e7b-4920-9178-61fb10ced3f3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:20.920514 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0eab998b-4e7b-4920-9178-61fb10ced3f3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:21.098040 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-0eab998b-4e7b-4920-9178-61fb10ced3f3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:21.106710 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-0eab998b-4e7b-4920-9178-61fb10ced3f3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:21.108208 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-0eab998b-4e7b-4920-9178-61fb10ced3f3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:21.109455 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-0eab998b-4e7b-4920-9178-61fb10ced3f3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1728 microversion: 2.20 time: 0.213404 Jul 04 10:14:21.110069 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 330/662] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:14:20 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1728 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 10:14:22.130192 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-a54956fd-505e-44e6-a56d-511dee63ec51 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:22.132479 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-a54956fd-505e-44e6-a56d-511dee63ec51 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:22.153448 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a54956fd-505e-44e6-a56d-511dee63ec51 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:22.154247 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a54956fd-505e-44e6-a56d-511dee63ec51 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:22.155290 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a54956fd-505e-44e6-a56d-511dee63ec51 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:22.155925 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a54956fd-505e-44e6-a56d-511dee63ec51 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:22.316147 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-a54956fd-505e-44e6-a56d-511dee63ec51 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:22.327483 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-a54956fd-505e-44e6-a56d-511dee63ec51 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:22.328887 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-a54956fd-505e-44e6-a56d-511dee63ec51 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:22.330225 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-a54956fd-505e-44e6-a56d-511dee63ec51 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1728 microversion: 2.20 time: 0.205344 Jul 04 10:14:22.331575 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 333/663] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:14:22 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1728 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:14:23.352235 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-e5f85f2c-3805-470e-869f-bac6ec172f40 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:23.352951 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-e5f85f2c-3805-470e-869f-bac6ec172f40 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:23.360440 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e5f85f2c-3805-470e-869f-bac6ec172f40 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:23.360901 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e5f85f2c-3805-470e-869f-bac6ec172f40 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:23.361712 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e5f85f2c-3805-470e-869f-bac6ec172f40 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:23.362281 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e5f85f2c-3805-470e-869f-bac6ec172f40 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:23.504386 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-e5f85f2c-3805-470e-869f-bac6ec172f40 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:23.514232 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-e5f85f2c-3805-470e-869f-bac6ec172f40 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:23.515920 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-e5f85f2c-3805-470e-869f-bac6ec172f40 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:23.517057 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-e5f85f2c-3805-470e-869f-bac6ec172f40 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1728 microversion: 2.20 time: 0.168990 Jul 04 10:14:23.517861 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 331/664] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:14:23 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 10:14:24.536027 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-1960c676-ba99-4760-b437-7b6879b8c191 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:24.537418 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-1960c676-ba99-4760-b437-7b6879b8c191 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:24.545981 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1960c676-ba99-4760-b437-7b6879b8c191 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:24.546418 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1960c676-ba99-4760-b437-7b6879b8c191 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:24.547222 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1960c676-ba99-4760-b437-7b6879b8c191 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:24.550233 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1960c676-ba99-4760-b437-7b6879b8c191 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:24.821506 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-1960c676-ba99-4760-b437-7b6879b8c191 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:24.843718 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-37df00da-4cc9-4625-aed0-9751f90b03e0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:24.851198 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-37df00da-4cc9-4625-aed0-9751f90b03e0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:24.854272 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-1960c676-ba99-4760-b437-7b6879b8c191 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:24.858772 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-1960c676-ba99-4760-b437-7b6879b8c191 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:24.863614 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-1960c676-ba99-4760-b437-7b6879b8c191 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1728 microversion: 2.20 time: 0.331180 Jul 04 10:14:24.876918 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 334/665] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:14:24 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1728 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:14:24.877452 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-37df00da-4cc9-4625-aed0-9751f90b03e0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:24.878235 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-37df00da-4cc9-4625-aed0-9751f90b03e0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:24.879411 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-37df00da-4cc9-4625-aed0-9751f90b03e0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:24.879994 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-37df00da-4cc9-4625-aed0-9751f90b03e0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:24.923211 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-37df00da-4cc9-4625-aed0-9751f90b03e0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90/ips" status: 200 len: 145 microversion: 2.1 time: 0.352519 Jul 04 10:14:24.923777 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 332/666] 10.222.0.79 () {58 vars in 1247 bytes} [Mon Jul 4 10:14:24 2022] GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90/ips => generated 145 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:14:24.936695 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-78b85acc-a284-444e-8578-8bb205d7bc91 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:14:24.937338 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-78b85acc-a284-444e-8578-8bb205d7bc91 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:24.949130 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-78b85acc-a284-444e-8578-8bb205d7bc91 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:24.949130 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-78b85acc-a284-444e-8578-8bb205d7bc91 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:24.949130 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-78b85acc-a284-444e-8578-8bb205d7bc91 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:24.949130 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-78b85acc-a284-444e-8578-8bb205d7bc91 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:24.980155 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.objects.instance [None req-78b85acc-a284-444e-8578-8bb205d7bc91 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lazy-loading 'flavor' on Instance uuid f9526d9a-e0e4-4708-a2da-872d57732128 {{(pid=117865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 10:14:25.103366 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-78b85acc-a284-444e-8578-8bb205d7bc91 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "POST /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128/action" status: 202 len: 0 microversion: 2.1 time: 0.170911 Jul 04 10:14:25.105262 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 335/667] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Jul 4 10:14:24 2022] POST /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 10:14:25.114263 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-bbfb0cc4-79ac-409f-a65c-25b7f2a2746f tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:25.114811 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-bbfb0cc4-79ac-409f-a65c-25b7f2a2746f tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:25.121520 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-bbfb0cc4-79ac-409f-a65c-25b7f2a2746f tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:25.124013 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-bbfb0cc4-79ac-409f-a65c-25b7f2a2746f tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:25.126029 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-bbfb0cc4-79ac-409f-a65c-25b7f2a2746f tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:25.127729 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-bbfb0cc4-79ac-409f-a65c-25b7f2a2746f tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:25.343403 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-bbfb0cc4-79ac-409f-a65c-25b7f2a2746f tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:25.387261 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-bbfb0cc4-79ac-409f-a65c-25b7f2a2746f tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1567 microversion: 2.1 time: 0.277250 Jul 04 10:14:25.388281 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 333/668] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:25 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1567 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:14:25.884087 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f5cbbee8-ee85-4b75-bf45-2585ef7090eb tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:25.885687 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f5cbbee8-ee85-4b75-bf45-2585ef7090eb tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:25.893146 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f5cbbee8-ee85-4b75-bf45-2585ef7090eb tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:25.894107 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f5cbbee8-ee85-4b75-bf45-2585ef7090eb tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:25.895061 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f5cbbee8-ee85-4b75-bf45-2585ef7090eb tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:25.895793 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f5cbbee8-ee85-4b75-bf45-2585ef7090eb tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:26.093921 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-f5cbbee8-ee85-4b75-bf45-2585ef7090eb tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:26.107359 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-f5cbbee8-ee85-4b75-bf45-2585ef7090eb tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:26.108875 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-f5cbbee8-ee85-4b75-bf45-2585ef7090eb tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:26.110264 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f5cbbee8-ee85-4b75-bf45-2585ef7090eb tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1728 microversion: 2.20 time: 0.230535 Jul 04 10:14:26.110819 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 336/669] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:14:25 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1728 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:14:26.407006 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-5cdd998b-ea1d-4747-a431-5c6342d2282d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:26.408310 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-5cdd998b-ea1d-4747-a431-5c6342d2282d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:26.415959 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5cdd998b-ea1d-4747-a431-5c6342d2282d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:26.416768 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5cdd998b-ea1d-4747-a431-5c6342d2282d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:26.417881 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5cdd998b-ea1d-4747-a431-5c6342d2282d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:26.418510 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5cdd998b-ea1d-4747-a431-5c6342d2282d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:26.422243 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:14:26.534841 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-9cb84f90-e5ea-49a4-9a0b-57aab17ca9cb tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e37f36f2-3c69-49c5-b472-d7d4b771e386"}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:14:26.535978 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-9cb84f90-e5ea-49a4-9a0b-57aab17ca9cb tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:26.553507 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9cb84f90-e5ea-49a4-9a0b-57aab17ca9cb tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:26.553978 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9cb84f90-e5ea-49a4-9a0b-57aab17ca9cb tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:26.554766 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9cb84f90-e5ea-49a4-9a0b-57aab17ca9cb tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:26.555197 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9cb84f90-e5ea-49a4-9a0b-57aab17ca9cb tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:26.666802 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-5cdd998b-ea1d-4747-a431-5c6342d2282d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:26.682628 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-5cdd998b-ea1d-4747-a431-5c6342d2282d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1567 microversion: 2.1 time: 0.279690 Jul 04 10:14:26.683877 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 334/670] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:26 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1567 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:27.129492 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-fc64de1e-32e5-4cc7-ad46-7cb59a1cb81c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:27.130127 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-fc64de1e-32e5-4cc7-ad46-7cb59a1cb81c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:27.143232 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-fc64de1e-32e5-4cc7-ad46-7cb59a1cb81c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:27.143680 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-fc64de1e-32e5-4cc7-ad46-7cb59a1cb81c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:27.144450 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-fc64de1e-32e5-4cc7-ad46-7cb59a1cb81c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:27.144876 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-fc64de1e-32e5-4cc7-ad46-7cb59a1cb81c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:27.329747 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-fc64de1e-32e5-4cc7-ad46-7cb59a1cb81c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:27.338742 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-fc64de1e-32e5-4cc7-ad46-7cb59a1cb81c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:27.340589 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-fc64de1e-32e5-4cc7-ad46-7cb59a1cb81c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:27.341815 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-fc64de1e-32e5-4cc7-ad46-7cb59a1cb81c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1728 microversion: 2.20 time: 0.217003 Jul 04 10:14:27.349123 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 335/671] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:14:27 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1728 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:14:27.700244 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-6b67987e-7a2a-45db-8a00-73c5b3b63a93 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:27.700985 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-6b67987e-7a2a-45db-8a00-73c5b3b63a93 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:27.708286 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-6b67987e-7a2a-45db-8a00-73c5b3b63a93 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:27.709056 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-6b67987e-7a2a-45db-8a00-73c5b3b63a93 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:27.710097 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-6b67987e-7a2a-45db-8a00-73c5b3b63a93 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:27.710853 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-6b67987e-7a2a-45db-8a00-73c5b3b63a93 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:27.858854 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-6b67987e-7a2a-45db-8a00-73c5b3b63a93 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:27.867135 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-6b67987e-7a2a-45db-8a00-73c5b3b63a93 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1567 microversion: 2.1 time: 0.171106 Jul 04 10:14:27.868011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 336/672] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:27 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:14:28.361159 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-cb3fce8b-8f60-49a6-8915-9367ea148db8 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:28.362000 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-cb3fce8b-8f60-49a6-8915-9367ea148db8 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:28.370894 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-cb3fce8b-8f60-49a6-8915-9367ea148db8 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:28.371337 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-cb3fce8b-8f60-49a6-8915-9367ea148db8 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:28.372287 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-cb3fce8b-8f60-49a6-8915-9367ea148db8 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:28.372702 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-cb3fce8b-8f60-49a6-8915-9367ea148db8 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:28.546554 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-cb3fce8b-8f60-49a6-8915-9367ea148db8 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:28.568865 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-cb3fce8b-8f60-49a6-8915-9367ea148db8 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:28.571102 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-cb3fce8b-8f60-49a6-8915-9367ea148db8 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:28.572859 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-cb3fce8b-8f60-49a6-8915-9367ea148db8 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1728 microversion: 2.20 time: 0.216151 Jul 04 10:14:28.573656 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 337/673] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:14:28 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1728 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 10:14:28.885775 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-f6db5438-8947-4e8f-bfae-95fb96d6d26d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:28.886503 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-f6db5438-8947-4e8f-bfae-95fb96d6d26d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:28.894656 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f6db5438-8947-4e8f-bfae-95fb96d6d26d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:28.895254 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f6db5438-8947-4e8f-bfae-95fb96d6d26d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:28.896294 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f6db5438-8947-4e8f-bfae-95fb96d6d26d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:28.896732 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f6db5438-8947-4e8f-bfae-95fb96d6d26d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:29.035540 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-f6db5438-8947-4e8f-bfae-95fb96d6d26d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:29.043695 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-f6db5438-8947-4e8f-bfae-95fb96d6d26d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1567 microversion: 2.1 time: 0.162158 Jul 04 10:14:29.044271 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 338/674] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:28 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:29.595325 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-38f65aa3-6d7b-4fa8-b465-ad9469cecd82 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:29.596291 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-38f65aa3-6d7b-4fa8-b465-ad9469cecd82 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:29.605723 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-38f65aa3-6d7b-4fa8-b465-ad9469cecd82 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:29.606154 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-38f65aa3-6d7b-4fa8-b465-ad9469cecd82 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:29.606911 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-38f65aa3-6d7b-4fa8-b465-ad9469cecd82 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:29.607339 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-38f65aa3-6d7b-4fa8-b465-ad9469cecd82 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:29.746156 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-38f65aa3-6d7b-4fa8-b465-ad9469cecd82 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:29.754338 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-38f65aa3-6d7b-4fa8-b465-ad9469cecd82 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:29.755832 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-38f65aa3-6d7b-4fa8-b465-ad9469cecd82 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:29.756998 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-38f65aa3-6d7b-4fa8-b465-ad9469cecd82 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1728 microversion: 2.20 time: 0.168752 Jul 04 10:14:29.757592 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 339/675] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:14:29 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:14:30.043177 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=5,nova_cell1:UPDATE=9 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:14:30.062023 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-02a86c39-d9a1-4952-840d-c0c49f930edb tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:30.062640 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-9cb84f90-e5ea-49a4-9a0b-57aab17ca9cb tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "POST /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.535607 Jul 04 10:14:30.062871 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-02a86c39-d9a1-4952-840d-c0c49f930edb tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:30.063174 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 337/676] 10.222.0.79 () {60 vars in 1322 bytes} [Mon Jul 4 10:14:26 2022] POST /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90/os-volume_attachments => generated 194 bytes in 3537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:14:30.071116 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-02a86c39-d9a1-4952-840d-c0c49f930edb tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:30.071731 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-02a86c39-d9a1-4952-840d-c0c49f930edb tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:30.072765 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-02a86c39-d9a1-4952-840d-c0c49f930edb tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:30.073590 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-02a86c39-d9a1-4952-840d-c0c49f930edb tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:30.220368 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-02a86c39-d9a1-4952-840d-c0c49f930edb tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:30.228433 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-02a86c39-d9a1-4952-840d-c0c49f930edb tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1567 microversion: 2.1 time: 0.171695 Jul 04 10:14:30.229037 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 340/677] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:30 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:14:30.776590 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-58e0b9e6-531b-4a8e-88be-77fa8ed492c7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:30.777265 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-58e0b9e6-531b-4a8e-88be-77fa8ed492c7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:30.784212 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-58e0b9e6-531b-4a8e-88be-77fa8ed492c7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:30.784935 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-58e0b9e6-531b-4a8e-88be-77fa8ed492c7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:30.785764 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-58e0b9e6-531b-4a8e-88be-77fa8ed492c7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:30.786195 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-58e0b9e6-531b-4a8e-88be-77fa8ed492c7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:30.924473 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-58e0b9e6-531b-4a8e-88be-77fa8ed492c7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:30.933266 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-58e0b9e6-531b-4a8e-88be-77fa8ed492c7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:30.935445 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-58e0b9e6-531b-4a8e-88be-77fa8ed492c7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:30.936609 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-58e0b9e6-531b-4a8e-88be-77fa8ed492c7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1728 microversion: 2.20 time: 0.164847 Jul 04 10:14:30.937249 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 338/678] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:14:30 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:14:31.246075 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-71aafd65-0a52-4d95-883a-610cd04b9af7 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:31.246795 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-71aafd65-0a52-4d95-883a-610cd04b9af7 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:31.253467 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-71aafd65-0a52-4d95-883a-610cd04b9af7 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:31.253902 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-71aafd65-0a52-4d95-883a-610cd04b9af7 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:31.254844 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-71aafd65-0a52-4d95-883a-610cd04b9af7 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:31.255418 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-71aafd65-0a52-4d95-883a-610cd04b9af7 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:31.395655 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-71aafd65-0a52-4d95-883a-610cd04b9af7 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:31.403157 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-71aafd65-0a52-4d95-883a-610cd04b9af7 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1567 microversion: 2.1 time: 0.160955 Jul 04 10:14:31.403881 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 341/679] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:31 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:31.955481 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-88466a3d-0181-4356-a621-3d7dc62fec7f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:31.956099 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-88466a3d-0181-4356-a621-3d7dc62fec7f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:31.963879 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-88466a3d-0181-4356-a621-3d7dc62fec7f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:31.964600 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-88466a3d-0181-4356-a621-3d7dc62fec7f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:31.965365 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-88466a3d-0181-4356-a621-3d7dc62fec7f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:31.965839 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-88466a3d-0181-4356-a621-3d7dc62fec7f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:32.101711 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-88466a3d-0181-4356-a621-3d7dc62fec7f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:32.109883 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-88466a3d-0181-4356-a621-3d7dc62fec7f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:32.111347 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-88466a3d-0181-4356-a621-3d7dc62fec7f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:32.112539 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-88466a3d-0181-4356-a621-3d7dc62fec7f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1728 microversion: 2.20 time: 0.161076 Jul 04 10:14:32.113073 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 339/680] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:14:31 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:14:32.420372 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-135434d9-72cc-48bb-a545-627a489dab2a tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:32.420929 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-135434d9-72cc-48bb-a545-627a489dab2a tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:32.427709 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-135434d9-72cc-48bb-a545-627a489dab2a tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:32.428146 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-135434d9-72cc-48bb-a545-627a489dab2a tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:32.428902 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-135434d9-72cc-48bb-a545-627a489dab2a tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:32.429327 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-135434d9-72cc-48bb-a545-627a489dab2a tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:32.567822 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-135434d9-72cc-48bb-a545-627a489dab2a tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:32.576861 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-135434d9-72cc-48bb-a545-627a489dab2a tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1567 microversion: 2.1 time: 0.160318 Jul 04 10:14:32.577573 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 342/681] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:32 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:32.908812 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-63d797ee-fc09-45f5-b99f-8e49e1921cd1 req-f9649488-d9f1-4fc9-b7c6-429dc485f656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a66cd362-4fe8-499f-850d-6755bd23c668", "name": "network-vif-plugged", "status": "completed", "tag": "4f41751d-4044-46c9-8fe9-0a9fdf5d5a79"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:14:32.918002 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-63d797ee-fc09-45f5-b99f-8e49e1921cd1 req-f9649488-d9f1-4fc9-b7c6-429dc485f656 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:32.919248 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-63d797ee-fc09-45f5-b99f-8e49e1921cd1 req-f9649488-d9f1-4fc9-b7c6-429dc485f656 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:32.931444 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-63d797ee-fc09-45f5-b99f-8e49e1921cd1 req-f9649488-d9f1-4fc9-b7c6-429dc485f656 service nova] Creating event network-vif-plugged:4f41751d-4044-46c9-8fe9-0a9fdf5d5a79 for instance a66cd362-4fe8-499f-850d-6755bd23c668 on hv-cinder-84841 Jul 04 10:14:32.938612 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-63d797ee-fc09-45f5-b99f-8e49e1921cd1 req-f9649488-d9f1-4fc9-b7c6-429dc485f656 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034008 Jul 04 10:14:32.939335 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 340/682] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:14:33.130970 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-687910ab-628f-404b-85e7-db28ee6c7a43 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:33.131643 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-687910ab-628f-404b-85e7-db28ee6c7a43 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:33.143543 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-687910ab-628f-404b-85e7-db28ee6c7a43 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:33.144195 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-687910ab-628f-404b-85e7-db28ee6c7a43 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:33.145039 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-687910ab-628f-404b-85e7-db28ee6c7a43 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:33.145413 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-687910ab-628f-404b-85e7-db28ee6c7a43 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:33.316043 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-687910ab-628f-404b-85e7-db28ee6c7a43 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:33.359744 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-687910ab-628f-404b-85e7-db28ee6c7a43 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:33.364869 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-687910ab-628f-404b-85e7-db28ee6c7a43 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:33.366557 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-687910ab-628f-404b-85e7-db28ee6c7a43 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1728 microversion: 2.20 time: 0.239598 Jul 04 10:14:33.367255 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 343/683] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:14:33 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1728 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:14:33.595073 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-968f8cae-d70b-414d-9695-6eb4b3958d4e tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:33.595767 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-968f8cae-d70b-414d-9695-6eb4b3958d4e tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:33.602049 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-968f8cae-d70b-414d-9695-6eb4b3958d4e tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:33.602493 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-968f8cae-d70b-414d-9695-6eb4b3958d4e tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:33.603247 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-968f8cae-d70b-414d-9695-6eb4b3958d4e tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:33.603704 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-968f8cae-d70b-414d-9695-6eb4b3958d4e tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:33.742414 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-968f8cae-d70b-414d-9695-6eb4b3958d4e tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:33.752363 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-968f8cae-d70b-414d-9695-6eb4b3958d4e tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1567 microversion: 2.1 time: 0.161506 Jul 04 10:14:33.752940 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 341/684] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:33 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:34.395555 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-ac314965-d378-43f2-a183-5fc757af7f4d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:34.396266 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-ac314965-d378-43f2-a183-5fc757af7f4d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:34.402619 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ac314965-d378-43f2-a183-5fc757af7f4d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:34.403069 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ac314965-d378-43f2-a183-5fc757af7f4d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:34.403910 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ac314965-d378-43f2-a183-5fc757af7f4d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:34.404337 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ac314965-d378-43f2-a183-5fc757af7f4d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:34.535813 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-ac314965-d378-43f2-a183-5fc757af7f4d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:34.543958 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-ac314965-d378-43f2-a183-5fc757af7f4d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:34.545916 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-ac314965-d378-43f2-a183-5fc757af7f4d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:34.547081 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-ac314965-d378-43f2-a183-5fc757af7f4d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1728 microversion: 2.20 time: 0.156043 Jul 04 10:14:34.547843 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 344/685] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:14:34 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:14:34.769632 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2293a206-50d7-47c0-8631-c13701e08501 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:34.770264 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-2293a206-50d7-47c0-8631-c13701e08501 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:34.777114 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2293a206-50d7-47c0-8631-c13701e08501 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:34.777590 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2293a206-50d7-47c0-8631-c13701e08501 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:34.778422 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2293a206-50d7-47c0-8631-c13701e08501 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:34.779125 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2293a206-50d7-47c0-8631-c13701e08501 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:34.926515 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-2293a206-50d7-47c0-8631-c13701e08501 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:34.936927 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-2293a206-50d7-47c0-8631-c13701e08501 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1567 microversion: 2.1 time: 0.171035 Jul 04 10:14:34.937555 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 342/686] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:34 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:35.567603 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-95b57135-593e-4514-b75f-742320e4e46d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:35.568337 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-95b57135-593e-4514-b75f-742320e4e46d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:35.577074 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-95b57135-593e-4514-b75f-742320e4e46d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:35.577549 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-95b57135-593e-4514-b75f-742320e4e46d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:35.578335 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-95b57135-593e-4514-b75f-742320e4e46d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:35.578765 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-95b57135-593e-4514-b75f-742320e4e46d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:35.711332 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-95b57135-593e-4514-b75f-742320e4e46d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:35.719773 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-95b57135-593e-4514-b75f-742320e4e46d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:35.721261 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-95b57135-593e-4514-b75f-742320e4e46d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:35.722443 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-95b57135-593e-4514-b75f-742320e4e46d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1715 microversion: 2.20 time: 0.160089 Jul 04 10:14:35.723010 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 345/687] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:14:35 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1715 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:14:35.960298 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-33746801-d183-4879-a752-7a0c4152dee3 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:35.961281 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-33746801-d183-4879-a752-7a0c4152dee3 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:35.969424 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-33746801-d183-4879-a752-7a0c4152dee3 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:35.969902 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-33746801-d183-4879-a752-7a0c4152dee3 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:35.970647 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-33746801-d183-4879-a752-7a0c4152dee3 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:35.971046 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-33746801-d183-4879-a752-7a0c4152dee3 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:36.123594 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-33746801-d183-4879-a752-7a0c4152dee3 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:36.132943 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-33746801-d183-4879-a752-7a0c4152dee3 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1567 microversion: 2.1 time: 0.179812 Jul 04 10:14:36.133633 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 343/688] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:35 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:37.151064 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-c89ce9cf-da15-4b8d-99e9-12cdc7c193ef tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:37.151735 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-c89ce9cf-da15-4b8d-99e9-12cdc7c193ef tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:37.159013 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c89ce9cf-da15-4b8d-99e9-12cdc7c193ef tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:37.159460 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c89ce9cf-da15-4b8d-99e9-12cdc7c193ef tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:37.160239 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c89ce9cf-da15-4b8d-99e9-12cdc7c193ef tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:37.160673 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c89ce9cf-da15-4b8d-99e9-12cdc7c193ef tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:37.402307 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-c89ce9cf-da15-4b8d-99e9-12cdc7c193ef tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:37.410441 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-c89ce9cf-da15-4b8d-99e9-12cdc7c193ef tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1567 microversion: 2.1 time: 0.264352 Jul 04 10:14:37.411020 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 346/689] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:37 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1567 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:37.622284 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-25cabed8-e2b5-496b-9ebe-092629d593c3 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:37.623444 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-25cabed8-e2b5-496b-9ebe-092629d593c3 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:37.630181 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-25cabed8-e2b5-496b-9ebe-092629d593c3 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:37.630627 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-25cabed8-e2b5-496b-9ebe-092629d593c3 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:37.631382 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-25cabed8-e2b5-496b-9ebe-092629d593c3 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:37.631809 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-25cabed8-e2b5-496b-9ebe-092629d593c3 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:37.663779 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-25cabed8-e2b5-496b-9ebe-092629d593c3 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045457 Jul 04 10:14:37.664349 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 344/690] 10.222.0.79 () {58 vars in 1301 bytes} [Mon Jul 4 10:14:37 2022] GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:14:37.674378 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-5ca2b6cc-15ab-4ce0-b6c6-dc2f9ae43c99 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:37.674868 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-5ca2b6cc-15ab-4ce0-b6c6-dc2f9ae43c99 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:37.680866 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5ca2b6cc-15ab-4ce0-b6c6-dc2f9ae43c99 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:37.681309 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5ca2b6cc-15ab-4ce0-b6c6-dc2f9ae43c99 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:37.682096 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5ca2b6cc-15ab-4ce0-b6c6-dc2f9ae43c99 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:37.682508 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-5ca2b6cc-15ab-4ce0-b6c6-dc2f9ae43c99 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:37.710820 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-5ca2b6cc-15ab-4ce0-b6c6-dc2f9ae43c99 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90/os-volume_attachments/e37f36f2-3c69-49c5-b472-d7d4b771e386" status: 200 len: 194 microversion: 2.1 time: 0.040407 Jul 04 10:14:37.711398 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 347/691] 10.222.0.79 () {58 vars in 1412 bytes} [Mon Jul 4 10:14:37 2022] GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90/os-volume_attachments/e37f36f2-3c69-49c5-b472-d7d4b771e386 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:14:38.428751 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-c363431b-7727-41de-b354-f553d6d55c06 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:38.429362 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-c363431b-7727-41de-b354-f553d6d55c06 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:38.437169 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c363431b-7727-41de-b354-f553d6d55c06 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:38.437807 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c363431b-7727-41de-b354-f553d6d55c06 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:38.438692 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c363431b-7727-41de-b354-f553d6d55c06 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:38.439151 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c363431b-7727-41de-b354-f553d6d55c06 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:38.581744 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-c363431b-7727-41de-b354-f553d6d55c06 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:38.593166 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-c363431b-7727-41de-b354-f553d6d55c06 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1567 microversion: 2.1 time: 0.165227 Jul 04 10:14:38.593166 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 345/692] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:38 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:39.041126 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-705484a4-db27-46c8-ba1c-117c2360d0e0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "081dd42f-ad09-4f47-af30-a9488e02e5a8"}} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:14:39.042290 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-705484a4-db27-46c8-ba1c-117c2360d0e0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:39.049469 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-705484a4-db27-46c8-ba1c-117c2360d0e0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:39.049953 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-705484a4-db27-46c8-ba1c-117c2360d0e0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:39.050717 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-705484a4-db27-46c8-ba1c-117c2360d0e0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:39.051141 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-705484a4-db27-46c8-ba1c-117c2360d0e0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:39.318842 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-705484a4-db27-46c8-ba1c-117c2360d0e0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "POST /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281528 Jul 04 10:14:39.324074 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 348/693] 10.222.0.79 () {60 vars in 1322 bytes} [Mon Jul 4 10:14:39 2022] POST /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 10:14:39.608200 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b19aa905-d6dd-4756-825a-c07445581587 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:39.608912 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-b19aa905-d6dd-4756-825a-c07445581587 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:39.615833 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b19aa905-d6dd-4756-825a-c07445581587 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:39.616371 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b19aa905-d6dd-4756-825a-c07445581587 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:39.617396 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b19aa905-d6dd-4756-825a-c07445581587 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:39.618052 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b19aa905-d6dd-4756-825a-c07445581587 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:39.756118 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-b19aa905-d6dd-4756-825a-c07445581587 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:39.766435 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-b19aa905-d6dd-4756-825a-c07445581587 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1567 microversion: 2.1 time: 0.162900 Jul 04 10:14:39.767003 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 346/694] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:39 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:40.676045 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-d40162ab-2cdc-4298-9fe1-d4bfa61bd84e tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-33704465", "imageRef": "80bd29b0-b77c-4611-be31-69ca559a2d2a", "flavorRef": "452", "networks": [{"uuid": "7cfa67a6-e002-4bb8-b37c-80e0c41eb386"}]}} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:14:40.739210 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.network.neutron [None req-d40162ab-2cdc-4298-9fe1-d4bfa61bd84e tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] validate_networks() for [('7cfa67a6-e002-4bb8-b37c-80e0c41eb386', None, None, None, None, None)] {{(pid=117866) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 10:14:40.787481 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-14ecb3ca-fbcb-4c5e-b108-48bee8753c14 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:40.788074 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-14ecb3ca-fbcb-4c5e-b108-48bee8753c14 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:40.794942 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-14ecb3ca-fbcb-4c5e-b108-48bee8753c14 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:40.795395 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-14ecb3ca-fbcb-4c5e-b108-48bee8753c14 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:40.796155 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-14ecb3ca-fbcb-4c5e-b108-48bee8753c14 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:40.796582 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-14ecb3ca-fbcb-4c5e-b108-48bee8753c14 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:40.978994 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-14ecb3ca-fbcb-4c5e-b108-48bee8753c14 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:40.987522 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-14ecb3ca-fbcb-4c5e-b108-48bee8753c14 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1567 microversion: 2.1 time: 0.203990 Jul 04 10:14:40.988136 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 347/695] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:40 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1567 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:41.202096 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-d40162ab-2cdc-4298-9fe1-d4bfa61bd84e tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Flavor limits 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 10:14:41.202489 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-d40162ab-2cdc-4298-9fe1-d4bfa61bd84e tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Image limits 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 10:14:41.202952 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-d40162ab-2cdc-4298-9fe1-d4bfa61bd84e tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Flavor pref 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 10:14:41.203351 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-d40162ab-2cdc-4298-9fe1-d4bfa61bd84e tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Image pref 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 10:14:41.203812 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-d40162ab-2cdc-4298-9fe1-d4bfa61bd84e tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 10:14:41.212819 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d40162ab-2cdc-4298-9fe1-d4bfa61bd84e tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:41.213264 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d40162ab-2cdc-4298-9fe1-d4bfa61bd84e tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:41.214503 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d40162ab-2cdc-4298-9fe1-d4bfa61bd84e tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:41.214931 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d40162ab-2cdc-4298-9fe1-d4bfa61bd84e tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:41.231528 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.quota [None req-d40162ab-2cdc-4298-9fe1-d4bfa61bd84e tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Getting quotas for project 02795b95a9b84564999233883b763e4f. Resources: {'cores', 'ram', 'instances'} {{(pid=117866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 10:14:41.235520 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.quota [None req-d40162ab-2cdc-4298-9fe1-d4bfa61bd84e tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Getting quotas for user 2495a8406c184164982d136edc351cfd and project 02795b95a9b84564999233883b763e4f. Resources: {'cores', 'ram', 'instances'} {{(pid=117866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 10:14:41.246501 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-d40162ab-2cdc-4298-9fe1-d4bfa61bd84e tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Going to run 1 instances... {{(pid=117866) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 10:14:41.248848 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-d40162ab-2cdc-4298-9fe1-d4bfa61bd84e tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: 82a2a58e-dfab-406a-a775-4a992d898eac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80bd29b0-b77c-4611-be31-69ca559a2d2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 10:14:41.297683 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-d40162ab-2cdc-4298-9fe1-d4bfa61bd84e tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.625939 Jul 04 10:14:41.298419 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 349/696] 10.222.0.79 () {60 vars in 1146 bytes} [Mon Jul 4 10:14:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 10:14:41.308708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-75550bbe-735f-440b-b3ff-7c45f17907f0 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:41.309307 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-75550bbe-735f-440b-b3ff-7c45f17907f0 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: 82a2a58e-dfab-406a-a775-4a992d898eac] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:41.364743 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-75550bbe-735f-440b-b3ff-7c45f17907f0 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495a8406c184164982d136edc351cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02795b95a9b84564999233883b763e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:41.371613 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-75550bbe-735f-440b-b3ff-7c45f17907f0 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "GET /compute/v2.1/servers/82a2a58e-dfab-406a-a775-4a992d898eac" status: 200 len: 1217 microversion: 2.1 time: 0.066874 Jul 04 10:14:41.372229 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 348/697] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:41 2022] GET /compute/v2.1/servers/82a2a58e-dfab-406a-a775-4a992d898eac => generated 1217 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:42.005588 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-808b2914-6c33-4d5c-8c9a-868e30182b8b tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:42.006209 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-808b2914-6c33-4d5c-8c9a-868e30182b8b tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:42.013425 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-808b2914-6c33-4d5c-8c9a-868e30182b8b tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:42.014173 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-808b2914-6c33-4d5c-8c9a-868e30182b8b tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:42.015130 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-808b2914-6c33-4d5c-8c9a-868e30182b8b tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:42.015560 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-808b2914-6c33-4d5c-8c9a-868e30182b8b tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:42.018448 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:14:42.153186 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-808b2914-6c33-4d5c-8c9a-868e30182b8b tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:42.161062 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-808b2914-6c33-4d5c-8c9a-868e30182b8b tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1567 microversion: 2.1 time: 0.160106 Jul 04 10:14:42.161652 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 350/698] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:41 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:42.391213 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e4e19ae5-3f2e-41d4-8de4-c75fd1b712eb tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:42.391955 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-e4e19ae5-3f2e-41d4-8de4-c75fd1b712eb tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: 82a2a58e-dfab-406a-a775-4a992d898eac] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:42.400588 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e4e19ae5-3f2e-41d4-8de4-c75fd1b712eb tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:42.401093 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e4e19ae5-3f2e-41d4-8de4-c75fd1b712eb tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:42.402302 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e4e19ae5-3f2e-41d4-8de4-c75fd1b712eb tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:42.402968 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e4e19ae5-3f2e-41d4-8de4-c75fd1b712eb tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:42.503262 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-e4e19ae5-3f2e-41d4-8de4-c75fd1b712eb tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495a8406c184164982d136edc351cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02795b95a9b84564999233883b763e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:42.515289 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-e4e19ae5-3f2e-41d4-8de4-c75fd1b712eb tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "GET /compute/v2.1/servers/82a2a58e-dfab-406a-a775-4a992d898eac" status: 200 len: 1277 microversion: 2.1 time: 0.129721 Jul 04 10:14:42.516617 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 349/699] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:42 2022] GET /compute/v2.1/servers/82a2a58e-dfab-406a-a775-4a992d898eac => generated 1277 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:43.177605 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-16d04cf7-5c36-4657-a429-78d43acbbf27 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:43.178319 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-16d04cf7-5c36-4657-a429-78d43acbbf27 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:43.185037 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-16d04cf7-5c36-4657-a429-78d43acbbf27 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:43.185558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-16d04cf7-5c36-4657-a429-78d43acbbf27 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:43.186448 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-16d04cf7-5c36-4657-a429-78d43acbbf27 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:43.186865 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-16d04cf7-5c36-4657-a429-78d43acbbf27 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:43.420600 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-16d04cf7-5c36-4657-a429-78d43acbbf27 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:43.430713 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-16d04cf7-5c36-4657-a429-78d43acbbf27 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1508 microversion: 2.1 time: 0.257237 Jul 04 10:14:43.431289 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 351/700] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:43 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1508 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:43.447862 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-caf65336-c445-4c15-a577-80365019c7ab tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:14:43.448440 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-caf65336-c445-4c15-a577-80365019c7ab tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:43.455855 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-caf65336-c445-4c15-a577-80365019c7ab tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:43.456350 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-caf65336-c445-4c15-a577-80365019c7ab tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:43.457137 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-caf65336-c445-4c15-a577-80365019c7ab tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:43.457572 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-caf65336-c445-4c15-a577-80365019c7ab tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:43.537547 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-caf65336-c445-4c15-a577-80365019c7ab tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "POST /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128/action" status: 202 len: 0 microversion: 2.1 time: 0.093788 Jul 04 10:14:43.538057 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-7c31da4c-c7de-4d29-b9b8-6ca52287d8de tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:43.538505 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 350/701] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Jul 4 10:14:43 2022] POST /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 10:14:43.539133 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-7c31da4c-c7de-4d29-b9b8-6ca52287d8de tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: 82a2a58e-dfab-406a-a775-4a992d898eac] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:43.546815 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7c31da4c-c7de-4d29-b9b8-6ca52287d8de tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:43.547276 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-95666271-feb4-4a85-8cce-78d6f299ef6b tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:43.547742 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-95666271-feb4-4a85-8cce-78d6f299ef6b tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:43.547859 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7c31da4c-c7de-4d29-b9b8-6ca52287d8de tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:43.549833 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7c31da4c-c7de-4d29-b9b8-6ca52287d8de tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:43.550181 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7c31da4c-c7de-4d29-b9b8-6ca52287d8de tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:43.554259 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-95666271-feb4-4a85-8cce-78d6f299ef6b tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:43.554706 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-95666271-feb4-4a85-8cce-78d6f299ef6b tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:43.555469 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-95666271-feb4-4a85-8cce-78d6f299ef6b tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:43.555900 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-95666271-feb4-4a85-8cce-78d6f299ef6b tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:43.860306 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-7c31da4c-c7de-4d29-b9b8-6ca52287d8de tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495a8406c184164982d136edc351cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02795b95a9b84564999233883b763e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:43.868188 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-7c31da4c-c7de-4d29-b9b8-6ca52287d8de tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "GET /compute/v2.1/servers/82a2a58e-dfab-406a-a775-4a992d898eac" status: 200 len: 1317 microversion: 2.1 time: 0.338356 Jul 04 10:14:43.868900 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 352/702] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:43 2022] GET /compute/v2.1/servers/82a2a58e-dfab-406a-a775-4a992d898eac => generated 1317 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:14:43.892133 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-95666271-feb4-4a85-8cce-78d6f299ef6b tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:43.902958 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-95666271-feb4-4a85-8cce-78d6f299ef6b tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1516 microversion: 2.1 time: 0.360157 Jul 04 10:14:43.903962 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 351/703] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:43 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1516 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:44.190101 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-6aafa11d-d405-4d12-acbb-5a0b3905e914 req-b04fe06e-f213-48ce-a554-75da20b832fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82a2a58e-dfab-406a-a775-4a992d898eac", "tag": "10abad8c-4bdd-4d14-9eee-86bb78bb17ad"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:14:44.198434 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-6aafa11d-d405-4d12-acbb-5a0b3905e914 req-b04fe06e-f213-48ce-a554-75da20b832fd service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:44.198834 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-6aafa11d-d405-4d12-acbb-5a0b3905e914 req-b04fe06e-f213-48ce-a554-75da20b832fd service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:44.209775 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-6aafa11d-d405-4d12-acbb-5a0b3905e914 req-b04fe06e-f213-48ce-a554-75da20b832fd service nova] Creating event network-changed:10abad8c-4bdd-4d14-9eee-86bb78bb17ad for instance 82a2a58e-dfab-406a-a775-4a992d898eac on hv-cinder-84841 Jul 04 10:14:44.214793 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-6aafa11d-d405-4d12-acbb-5a0b3905e914 req-b04fe06e-f213-48ce-a554-75da20b832fd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173253 Jul 04 10:14:44.215519 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 353/704] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:14:44.887019 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-be7547d7-637f-4f92-bfe2-a5c9e20f257e tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:44.887626 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-be7547d7-637f-4f92-bfe2-a5c9e20f257e tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: 82a2a58e-dfab-406a-a775-4a992d898eac] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:44.894387 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-be7547d7-637f-4f92-bfe2-a5c9e20f257e tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:44.894886 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-be7547d7-637f-4f92-bfe2-a5c9e20f257e tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:44.895696 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-be7547d7-637f-4f92-bfe2-a5c9e20f257e tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:44.896834 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-f5d817e1-28ea-4732-92db-9da385b959ba req-d21114dd-e8f7-4893-b437-6559afb80cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9526d9a-e0e4-4708-a2da-872d57732128", "name": "network-vif-unplugged", "status": "completed", "tag": "0561989e-f05a-46b1-a7cf-00085ff7229a"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:14:44.897001 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-be7547d7-637f-4f92-bfe2-a5c9e20f257e tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:44.905481 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-f5d817e1-28ea-4732-92db-9da385b959ba req-d21114dd-e8f7-4893-b437-6559afb80cd5 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:44.905976 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-f5d817e1-28ea-4732-92db-9da385b959ba req-d21114dd-e8f7-4893-b437-6559afb80cd5 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:44.919396 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.compute.server_external_events [req-f5d817e1-28ea-4732-92db-9da385b959ba req-d21114dd-e8f7-4893-b437-6559afb80cd5 service nova] Unable to find a host for instance f9526d9a-e0e4-4708-a2da-872d57732128. Dropping event network-vif-unplugged {{(pid=117866) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 04 10:14:44.920310 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-f5d817e1-28ea-4732-92db-9da385b959ba req-d21114dd-e8f7-4893-b437-6559afb80cd5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029431 Jul 04 10:14:44.920866 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 354/705] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 04 10:14:44.925547 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-b48b77ba-647b-449a-a04b-e31d23c21fe4 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:44.926504 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-b48b77ba-647b-449a-a04b-e31d23c21fe4 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:44.932668 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b48b77ba-647b-449a-a04b-e31d23c21fe4 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:44.933102 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b48b77ba-647b-449a-a04b-e31d23c21fe4 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:44.933866 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b48b77ba-647b-449a-a04b-e31d23c21fe4 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:44.934653 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b48b77ba-647b-449a-a04b-e31d23c21fe4 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:45.090048 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-be7547d7-637f-4f92-bfe2-a5c9e20f257e tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495a8406c184164982d136edc351cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02795b95a9b84564999233883b763e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:45.098036 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-be7547d7-637f-4f92-bfe2-a5c9e20f257e tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "GET /compute/v2.1/servers/82a2a58e-dfab-406a-a775-4a992d898eac" status: 200 len: 1317 microversion: 2.1 time: 0.214986 Jul 04 10:14:45.098986 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 352/706] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:44 2022] GET /compute/v2.1/servers/82a2a58e-dfab-406a-a775-4a992d898eac => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:45.122039 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-b48b77ba-647b-449a-a04b-e31d23c21fe4 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:45.130181 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-b48b77ba-647b-449a-a04b-e31d23c21fe4 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1518 microversion: 2.1 time: 0.208152 Jul 04 10:14:45.130757 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 355/707] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:44 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1518 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:46.118082 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-6e875667-4fa7-4753-91e1-439827e77015 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:46.118919 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-6e875667-4fa7-4753-91e1-439827e77015 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: 82a2a58e-dfab-406a-a775-4a992d898eac] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:46.122258 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=56 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:14:46.130261 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6e875667-4fa7-4753-91e1-439827e77015 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:46.130938 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6e875667-4fa7-4753-91e1-439827e77015 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:46.131971 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6e875667-4fa7-4753-91e1-439827e77015 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:46.132547 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6e875667-4fa7-4753-91e1-439827e77015 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:46.148864 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-58a74632-01eb-4c1d-bf42-fd3d359e4756 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:46.149387 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-58a74632-01eb-4c1d-bf42-fd3d359e4756 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:46.156680 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-58a74632-01eb-4c1d-bf42-fd3d359e4756 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:46.157123 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-58a74632-01eb-4c1d-bf42-fd3d359e4756 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:46.157922 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-58a74632-01eb-4c1d-bf42-fd3d359e4756 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:46.158354 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-58a74632-01eb-4c1d-bf42-fd3d359e4756 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:46.365226 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-6e875667-4fa7-4753-91e1-439827e77015 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495a8406c184164982d136edc351cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02795b95a9b84564999233883b763e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:46.373503 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-6e875667-4fa7-4753-91e1-439827e77015 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "GET /compute/v2.1/servers/82a2a58e-dfab-406a-a775-4a992d898eac" status: 200 len: 1317 microversion: 2.1 time: 0.261148 Jul 04 10:14:46.374174 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 353/708] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:46 2022] GET /compute/v2.1/servers/82a2a58e-dfab-406a-a775-4a992d898eac => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:46.406662 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-58a74632-01eb-4c1d-bf42-fd3d359e4756 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:46.414894 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-58a74632-01eb-4c1d-bf42-fd3d359e4756 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1518 microversion: 2.1 time: 0.270056 Jul 04 10:14:46.415765 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 356/709] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:46 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1518 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:46.652518 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-19f97084-0e0c-4759-9a97-52c98a757043 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:46.652997 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-19f97084-0e0c-4759-9a97-52c98a757043 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a16e6a2a-ad39-4e14-9cee-083afb6e9745] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:46.660139 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-19f97084-0e0c-4759-9a97-52c98a757043 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:46.661204 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-19f97084-0e0c-4759-9a97-52c98a757043 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:46.662407 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-19f97084-0e0c-4759-9a97-52c98a757043 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:46.662836 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-19f97084-0e0c-4759-9a97-52c98a757043 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:46.690440 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-19f97084-0e0c-4759-9a97-52c98a757043 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745/ips" status: 200 len: 149 microversion: 2.1 time: 0.042097 Jul 04 10:14:46.691020 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 354/710] 10.222.0.79 () {58 vars in 1247 bytes} [Mon Jul 4 10:14:46 2022] GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:14:47.026908 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-c28874f5-705d-4497-a417-27683b45e3e6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:47.027950 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-c28874f5-705d-4497-a417-27683b45e3e6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:47.034458 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c28874f5-705d-4497-a417-27683b45e3e6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:47.035391 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c28874f5-705d-4497-a417-27683b45e3e6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:47.037175 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c28874f5-705d-4497-a417-27683b45e3e6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:47.037804 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c28874f5-705d-4497-a417-27683b45e3e6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:47.078858 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-c28874f5-705d-4497-a417-27683b45e3e6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.060721 Jul 04 10:14:47.079707 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 357/711] 10.222.0.79 () {58 vars in 1301 bytes} [Mon Jul 4 10:14:47 2022] GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90/os-volume_attachments => generated 371 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:14:47.237900 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-19c042a4-3af4-467f-8f8f-3d18f281c642 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:47.238467 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-19c042a4-3af4-467f-8f8f-3d18f281c642 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:47.245823 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-19c042a4-3af4-467f-8f8f-3d18f281c642 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:47.246276 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-19c042a4-3af4-467f-8f8f-3d18f281c642 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:47.247053 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-19c042a4-3af4-467f-8f8f-3d18f281c642 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:47.247479 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-19c042a4-3af4-467f-8f8f-3d18f281c642 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:47.251153 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:14:47.279695 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-19c042a4-3af4-467f-8f8f-3d18f281c642 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90/os-volume_attachments/e37f36f2-3c69-49c5-b472-d7d4b771e386" status: 200 len: 194 microversion: 2.1 time: 0.045936 Jul 04 10:14:47.280304 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 355/712] 10.222.0.79 () {58 vars in 1412 bytes} [Mon Jul 4 10:14:47 2022] GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90/os-volume_attachments/e37f36f2-3c69-49c5-b472-d7d4b771e386 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:14:47.290493 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-4bdd815b-413d-4b5f-8724-c5234d058a95 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:47.291012 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-4bdd815b-413d-4b5f-8724-c5234d058a95 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:47.297223 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-4bdd815b-413d-4b5f-8724-c5234d058a95 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:47.297684 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-4bdd815b-413d-4b5f-8724-c5234d058a95 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:47.298783 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-4bdd815b-413d-4b5f-8724-c5234d058a95 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:47.299250 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-4bdd815b-413d-4b5f-8724-c5234d058a95 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:47.388101 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.objects.instance [None req-4bdd815b-413d-4b5f-8724-c5234d058a95 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lazy-loading 'services' on Instance uuid 383b09a2-bd4d-450c-9be6-413d465e3f90 {{(pid=117866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 10:14:47.390576 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f6ee819b-9226-4bad-83bb-41d48f2f81e5 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:47.391307 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f6ee819b-9226-4bad-83bb-41d48f2f81e5 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: 82a2a58e-dfab-406a-a775-4a992d898eac] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:47.397795 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f6ee819b-9226-4bad-83bb-41d48f2f81e5 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:47.398490 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f6ee819b-9226-4bad-83bb-41d48f2f81e5 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:47.399491 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f6ee819b-9226-4bad-83bb-41d48f2f81e5 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:47.400131 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f6ee819b-9226-4bad-83bb-41d48f2f81e5 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:47.514326 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-4bdd815b-413d-4b5f-8724-c5234d058a95 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "DELETE /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90/os-volume_attachments/e37f36f2-3c69-49c5-b472-d7d4b771e386" status: 202 len: 0 microversion: 2.1 time: 0.227964 Jul 04 10:14:47.518207 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 358/713] 10.222.0.79 () {58 vars in 1415 bytes} [Mon Jul 4 10:14:47 2022] DELETE /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90/os-volume_attachments/e37f36f2-3c69-49c5-b472-d7d4b771e386 => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 10:14:47.520391 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-a96b4d40-5ba6-4980-8017-982d9165cb58 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:47.521279 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-a96b4d40-5ba6-4980-8017-982d9165cb58 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:47.527156 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:14:47.529099 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a96b4d40-5ba6-4980-8017-982d9165cb58 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:47.529548 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a96b4d40-5ba6-4980-8017-982d9165cb58 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:47.530372 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a96b4d40-5ba6-4980-8017-982d9165cb58 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:47.530988 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a96b4d40-5ba6-4980-8017-982d9165cb58 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:47.872063 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-f6ee819b-9226-4bad-83bb-41d48f2f81e5 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495a8406c184164982d136edc351cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02795b95a9b84564999233883b763e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:47.880269 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f6ee819b-9226-4bad-83bb-41d48f2f81e5 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "GET /compute/v2.1/servers/82a2a58e-dfab-406a-a775-4a992d898eac" status: 200 len: 1317 microversion: 2.1 time: 0.493134 Jul 04 10:14:47.880847 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 356/714] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:47 2022] GET /compute/v2.1/servers/82a2a58e-dfab-406a-a775-4a992d898eac => generated 1317 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:47.980007 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-a96b4d40-5ba6-4980-8017-982d9165cb58 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:47.987455 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-a96b4d40-5ba6-4980-8017-982d9165cb58 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1574 microversion: 2.1 time: 0.471263 Jul 04 10:14:47.988037 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 359/715] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:47 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1574 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:48.056606 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-73c435d6-a0ad-4786-9f27-43c2d2813fd8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06fac37c-49fb-4099-916c-55042b65f5ff"}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:14:48.057651 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-73c435d6-a0ad-4786-9f27-43c2d2813fd8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a16e6a2a-ad39-4e14-9cee-083afb6e9745] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:48.063842 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-73c435d6-a0ad-4786-9f27-43c2d2813fd8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:48.064286 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-73c435d6-a0ad-4786-9f27-43c2d2813fd8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:48.065040 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-73c435d6-a0ad-4786-9f27-43c2d2813fd8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:48.065468 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-73c435d6-a0ad-4786-9f27-43c2d2813fd8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:48.479915 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-73c435d6-a0ad-4786-9f27-43c2d2813fd8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "POST /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.427142 Jul 04 10:14:48.481708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 357/716] 10.222.0.79 () {60 vars in 1322 bytes} [Mon Jul 4 10:14:48 2022] POST /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745/os-volume_attachments => generated 194 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:14:48.650190 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-4c7c0ecc-90d0-4c5d-81dc-c749c7f65259 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:48.650699 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-4c7c0ecc-90d0-4c5d-81dc-c749c7f65259 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:48.657682 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-4c7c0ecc-90d0-4c5d-81dc-c749c7f65259 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:48.658138 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-4c7c0ecc-90d0-4c5d-81dc-c749c7f65259 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:48.658950 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-4c7c0ecc-90d0-4c5d-81dc-c749c7f65259 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:48.659387 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-4c7c0ecc-90d0-4c5d-81dc-c749c7f65259 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:48.688988 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-4c7c0ecc-90d0-4c5d-81dc-c749c7f65259 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90/os-volume_attachments/081dd42f-ad09-4f47-af30-a9488e02e5a8" status: 200 len: 194 microversion: 2.1 time: 0.043002 Jul 04 10:14:48.689763 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 360/717] 10.222.0.79 () {58 vars in 1412 bytes} [Mon Jul 4 10:14:48 2022] GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90/os-volume_attachments/081dd42f-ad09-4f47-af30-a9488e02e5a8 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:14:48.701249 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8bed84f5-721a-4cff-be10-72e2f98cf812 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:48.701861 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-8bed84f5-721a-4cff-be10-72e2f98cf812 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:48.708185 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8bed84f5-721a-4cff-be10-72e2f98cf812 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:48.708713 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8bed84f5-721a-4cff-be10-72e2f98cf812 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:48.709483 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8bed84f5-721a-4cff-be10-72e2f98cf812 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:48.709953 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8bed84f5-721a-4cff-be10-72e2f98cf812 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:48.792136 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.objects.instance [None req-8bed84f5-721a-4cff-be10-72e2f98cf812 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lazy-loading 'services' on Instance uuid 383b09a2-bd4d-450c-9be6-413d465e3f90 {{(pid=117865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 10:14:48.871632 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-8bed84f5-721a-4cff-be10-72e2f98cf812 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "DELETE /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90/os-volume_attachments/081dd42f-ad09-4f47-af30-a9488e02e5a8" status: 202 len: 0 microversion: 2.1 time: 0.175072 Jul 04 10:14:48.872499 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 358/718] 10.222.0.79 () {58 vars in 1415 bytes} [Mon Jul 4 10:14:48 2022] DELETE /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90/os-volume_attachments/081dd42f-ad09-4f47-af30-a9488e02e5a8 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 10:14:48.897764 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-b25b56ac-e69f-4362-bbf4-575a13ccc2fa tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:48.898650 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-b25b56ac-e69f-4362-bbf4-575a13ccc2fa tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: 82a2a58e-dfab-406a-a775-4a992d898eac] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:48.905482 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b25b56ac-e69f-4362-bbf4-575a13ccc2fa tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:48.906155 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b25b56ac-e69f-4362-bbf4-575a13ccc2fa tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:48.907324 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b25b56ac-e69f-4362-bbf4-575a13ccc2fa tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:48.907935 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b25b56ac-e69f-4362-bbf4-575a13ccc2fa tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:49.006703 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-a4a1deab-225f-4b12-a6c6-5c44f3ce6beb tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:49.007657 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-a4a1deab-225f-4b12-a6c6-5c44f3ce6beb tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:49.018552 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a4a1deab-225f-4b12-a6c6-5c44f3ce6beb tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:49.019318 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a4a1deab-225f-4b12-a6c6-5c44f3ce6beb tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:49.021097 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a4a1deab-225f-4b12-a6c6-5c44f3ce6beb tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:49.021786 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a4a1deab-225f-4b12-a6c6-5c44f3ce6beb tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:49.072227 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-b25b56ac-e69f-4362-bbf4-575a13ccc2fa tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495a8406c184164982d136edc351cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02795b95a9b84564999233883b763e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:49.080527 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-b25b56ac-e69f-4362-bbf4-575a13ccc2fa tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "GET /compute/v2.1/servers/82a2a58e-dfab-406a-a775-4a992d898eac" status: 200 len: 1317 microversion: 2.1 time: 0.187009 Jul 04 10:14:49.081469 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 361/719] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:48 2022] GET /compute/v2.1/servers/82a2a58e-dfab-406a-a775-4a992d898eac => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:49.116050 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-b9895032-0f11-4ac2-bca2-43ff3e2b4ffc req-69391ba6-70f0-4028-a5c5-5cc8dc81d636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82a2a58e-dfab-406a-a775-4a992d898eac", "name": "network-vif-plugged", "status": "completed", "tag": "10abad8c-4bdd-4d14-9eee-86bb78bb17ad"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:14:49.135994 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-b9895032-0f11-4ac2-bca2-43ff3e2b4ffc req-69391ba6-70f0-4028-a5c5-5cc8dc81d636 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:49.136532 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-b9895032-0f11-4ac2-bca2-43ff3e2b4ffc req-69391ba6-70f0-4028-a5c5-5cc8dc81d636 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:49.151486 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-b9895032-0f11-4ac2-bca2-43ff3e2b4ffc req-69391ba6-70f0-4028-a5c5-5cc8dc81d636 service nova] Creating event network-vif-plugged:10abad8c-4bdd-4d14-9eee-86bb78bb17ad for instance 82a2a58e-dfab-406a-a775-4a992d898eac on hv-cinder-84841 Jul 04 10:14:49.156874 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-b9895032-0f11-4ac2-bca2-43ff3e2b4ffc req-69391ba6-70f0-4028-a5c5-5cc8dc81d636 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047006 Jul 04 10:14:49.157980 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 362/720] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 10:14:49.185040 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-a4a1deab-225f-4b12-a6c6-5c44f3ce6beb tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:49.193811 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-a4a1deab-225f-4b12-a6c6-5c44f3ce6beb tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1574 microversion: 2.1 time: 0.192943 Jul 04 10:14:49.194424 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 359/721] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:48 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1574 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:14:50.102403 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-db443171-99c3-4984-ae27-211dfd695a2c tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:50.103272 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-db443171-99c3-4984-ae27-211dfd695a2c tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: 82a2a58e-dfab-406a-a775-4a992d898eac] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:50.112062 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-db443171-99c3-4984-ae27-211dfd695a2c tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:50.112652 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-db443171-99c3-4984-ae27-211dfd695a2c tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:50.113672 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-db443171-99c3-4984-ae27-211dfd695a2c tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:50.114274 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-db443171-99c3-4984-ae27-211dfd695a2c tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:50.210744 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-18b48fb8-de21-493e-b59b-87a8c1400ca9 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:50.211377 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-18b48fb8-de21-493e-b59b-87a8c1400ca9 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:50.218848 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-18b48fb8-de21-493e-b59b-87a8c1400ca9 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:50.219260 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-18b48fb8-de21-493e-b59b-87a8c1400ca9 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:50.220088 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-18b48fb8-de21-493e-b59b-87a8c1400ca9 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:50.220517 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-18b48fb8-de21-493e-b59b-87a8c1400ca9 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:50.253390 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-db443171-99c3-4984-ae27-211dfd695a2c tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495a8406c184164982d136edc351cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02795b95a9b84564999233883b763e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:50.261384 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-db443171-99c3-4984-ae27-211dfd695a2c tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "GET /compute/v2.1/servers/82a2a58e-dfab-406a-a775-4a992d898eac" status: 200 len: 1317 microversion: 2.1 time: 0.166024 Jul 04 10:14:50.262100 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 363/722] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:50 2022] GET /compute/v2.1/servers/82a2a58e-dfab-406a-a775-4a992d898eac => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:50.355969 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-18b48fb8-de21-493e-b59b-87a8c1400ca9 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:50.365552 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-18b48fb8-de21-493e-b59b-87a8c1400ca9 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1574 microversion: 2.1 time: 0.159009 Jul 04 10:14:50.366174 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 360/723] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:50 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:51.282470 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-1f70b827-4c27-4611-92c6-c2187571e1af tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:51.283463 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-1f70b827-4c27-4611-92c6-c2187571e1af tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: 82a2a58e-dfab-406a-a775-4a992d898eac] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:51.287784 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell0:SELECT=2 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:14:51.288881 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell0:SELECT=6 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:14:51.298599 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1f70b827-4c27-4611-92c6-c2187571e1af tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:51.299331 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1f70b827-4c27-4611-92c6-c2187571e1af tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:51.300587 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1f70b827-4c27-4611-92c6-c2187571e1af tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:51.301495 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1f70b827-4c27-4611-92c6-c2187571e1af tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:51.383577 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-cc984c81-74c2-468d-b7ed-9ddadb322e9b tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:51.384278 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-cc984c81-74c2-468d-b7ed-9ddadb322e9b tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:51.386994 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:14:51.392785 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cc984c81-74c2-468d-b7ed-9ddadb322e9b tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:51.393297 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cc984c81-74c2-468d-b7ed-9ddadb322e9b tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:51.394207 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cc984c81-74c2-468d-b7ed-9ddadb322e9b tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:51.394698 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cc984c81-74c2-468d-b7ed-9ddadb322e9b tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:51.450034 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-1f70b827-4c27-4611-92c6-c2187571e1af tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495a8406c184164982d136edc351cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02795b95a9b84564999233883b763e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:51.457732 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-1f70b827-4c27-4611-92c6-c2187571e1af tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "GET /compute/v2.1/servers/82a2a58e-dfab-406a-a775-4a992d898eac" status: 200 len: 1507 microversion: 2.1 time: 0.181856 Jul 04 10:14:51.458331 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 364/724] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:51 2022] GET /compute/v2.1/servers/82a2a58e-dfab-406a-a775-4a992d898eac => generated 1507 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:51.538552 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-cc984c81-74c2-468d-b7ed-9ddadb322e9b tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:51.546722 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-cc984c81-74c2-468d-b7ed-9ddadb322e9b tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1574 microversion: 2.1 time: 0.167372 Jul 04 10:14:51.547261 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 361/725] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:51 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:52.569337 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-76046471-f366-43ff-ac93-6715eb9fa740 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:52.570314 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-76046471-f366-43ff-ac93-6715eb9fa740 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:52.581225 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-76046471-f366-43ff-ac93-6715eb9fa740 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:52.581963 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-76046471-f366-43ff-ac93-6715eb9fa740 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:52.583115 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-76046471-f366-43ff-ac93-6715eb9fa740 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:52.583765 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-76046471-f366-43ff-ac93-6715eb9fa740 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:52.722240 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-76046471-f366-43ff-ac93-6715eb9fa740 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:52.730474 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-76046471-f366-43ff-ac93-6715eb9fa740 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1574 microversion: 2.1 time: 0.168453 Jul 04 10:14:52.731062 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 365/726] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:52 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1574 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:53.751103 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-6ed01a17-c7fc-46f4-b4ca-e79ebbcff343 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:53.751677 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-6ed01a17-c7fc-46f4-b4ca-e79ebbcff343 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:53.760392 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6ed01a17-c7fc-46f4-b4ca-e79ebbcff343 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:53.760849 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6ed01a17-c7fc-46f4-b4ca-e79ebbcff343 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:53.761593 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6ed01a17-c7fc-46f4-b4ca-e79ebbcff343 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:53.762052 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6ed01a17-c7fc-46f4-b4ca-e79ebbcff343 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:53.897238 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-6ed01a17-c7fc-46f4-b4ca-e79ebbcff343 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:53.905188 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-6ed01a17-c7fc-46f4-b4ca-e79ebbcff343 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1574 microversion: 2.1 time: 0.160233 Jul 04 10:14:53.905782 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 362/727] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:53 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:54.922230 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-383f4711-96d4-45d1-bc2a-efb8327caee6 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:54.922926 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-383f4711-96d4-45d1-bc2a-efb8327caee6 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:54.931854 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-383f4711-96d4-45d1-bc2a-efb8327caee6 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:54.932301 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-383f4711-96d4-45d1-bc2a-efb8327caee6 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:54.933123 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-383f4711-96d4-45d1-bc2a-efb8327caee6 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:54.933767 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-383f4711-96d4-45d1-bc2a-efb8327caee6 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:55.079110 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-383f4711-96d4-45d1-bc2a-efb8327caee6 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:55.087242 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-383f4711-96d4-45d1-bc2a-efb8327caee6 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1574 microversion: 2.1 time: 0.169154 Jul 04 10:14:55.087921 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 366/728] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:54 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:56.105247 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e8584e19-9d11-4241-84c1-41c5d2d8e32a tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:56.106126 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-e8584e19-9d11-4241-84c1-41c5d2d8e32a tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:56.110742 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-e33ab741-afb6-4db5-945b-7634d454dea8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:56.111383 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-e33ab741-afb6-4db5-945b-7634d454dea8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a16e6a2a-ad39-4e14-9cee-083afb6e9745] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:56.113149 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e8584e19-9d11-4241-84c1-41c5d2d8e32a tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:56.113858 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e8584e19-9d11-4241-84c1-41c5d2d8e32a tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:56.114734 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e8584e19-9d11-4241-84c1-41c5d2d8e32a tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:56.115282 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e8584e19-9d11-4241-84c1-41c5d2d8e32a tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:56.124691 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e33ab741-afb6-4db5-945b-7634d454dea8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:56.125340 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e33ab741-afb6-4db5-945b-7634d454dea8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:56.126374 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e33ab741-afb6-4db5-945b-7634d454dea8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:56.126804 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e33ab741-afb6-4db5-945b-7634d454dea8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:56.219729 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.objects.instance [None req-e33ab741-afb6-4db5-945b-7634d454dea8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lazy-loading 'services' on Instance uuid a16e6a2a-ad39-4e14-9cee-083afb6e9745 {{(pid=117866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 10:14:56.223930 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:14:56.263105 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-e8584e19-9d11-4241-84c1-41c5d2d8e32a tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:56.272054 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-e8584e19-9d11-4241-84c1-41c5d2d8e32a tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1574 microversion: 2.1 time: 0.171005 Jul 04 10:14:56.282174 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 363/729] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:56 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1574 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:56.301154 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-e33ab741-afb6-4db5-945b-7634d454dea8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745/os-volume_attachments/06fac37c-49fb-4099-916c-55042b65f5ff" status: 202 len: 0 microversion: 2.1 time: 0.194339 Jul 04 10:14:56.302037 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 367/730] 10.222.0.79 () {58 vars in 1415 bytes} [Mon Jul 4 10:14:56 2022] DELETE /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745/os-volume_attachments/06fac37c-49fb-4099-916c-55042b65f5ff => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 04 10:14:56.310994 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5c530ab4-223b-4147-a1db-6ab7c537fb13 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:56.311975 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-5c530ab4-223b-4147-a1db-6ab7c537fb13 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a16e6a2a-ad39-4e14-9cee-083afb6e9745] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:56.319900 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5c530ab4-223b-4147-a1db-6ab7c537fb13 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:56.320651 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5c530ab4-223b-4147-a1db-6ab7c537fb13 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:56.321580 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5c530ab4-223b-4147-a1db-6ab7c537fb13 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:56.322187 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5c530ab4-223b-4147-a1db-6ab7c537fb13 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:56.355800 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-5c530ab4-223b-4147-a1db-6ab7c537fb13 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048646 Jul 04 10:14:56.356641 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 364/731] 10.222.0.79 () {58 vars in 1301 bytes} [Mon Jul 4 10:14:56 2022] GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 10:14:56.425742 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-3c412341-8582-4b76-a70b-4dfb65e006aa tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:56.426822 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-3c412341-8582-4b76-a70b-4dfb65e006aa tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:56.433858 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3c412341-8582-4b76-a70b-4dfb65e006aa tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:56.434304 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3c412341-8582-4b76-a70b-4dfb65e006aa tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:56.435056 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3c412341-8582-4b76-a70b-4dfb65e006aa tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:56.435485 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3c412341-8582-4b76-a70b-4dfb65e006aa tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:56.470387 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-3c412341-8582-4b76-a70b-4dfb65e006aa tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048905 Jul 04 10:14:56.470994 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 368/732] 10.222.0.79 () {58 vars in 1301 bytes} [Mon Jul 4 10:14:56 2022] GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 10:14:56.579068 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-02476e40-4c6c-4836-befa-1fd014f327d1 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:56.580034 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-02476e40-4c6c-4836-befa-1fd014f327d1 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:56.586331 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-02476e40-4c6c-4836-befa-1fd014f327d1 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:56.586764 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-02476e40-4c6c-4836-befa-1fd014f327d1 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:56.587507 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-02476e40-4c6c-4836-befa-1fd014f327d1 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:56.587925 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-02476e40-4c6c-4836-befa-1fd014f327d1 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:56.616626 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-02476e40-4c6c-4836-befa-1fd014f327d1 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041467 Jul 04 10:14:56.617082 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 365/733] 10.222.0.79 () {58 vars in 1301 bytes} [Mon Jul 4 10:14:56 2022] GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 10:14:56.679920 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-7df8483c-34e0-4daa-b615-3573522c22a2 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:56.680562 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-7df8483c-34e0-4daa-b615-3573522c22a2 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:56.690195 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7df8483c-34e0-4daa-b615-3573522c22a2 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:56.690929 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7df8483c-34e0-4daa-b615-3573522c22a2 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:56.692150 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7df8483c-34e0-4daa-b615-3573522c22a2 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:56.692797 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7df8483c-34e0-4daa-b615-3573522c22a2 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:56.719165 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-7df8483c-34e0-4daa-b615-3573522c22a2 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] Going to try to terminate instance {{(pid=117866) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 10:14:56.805805 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-7df8483c-34e0-4daa-b615-3573522c22a2 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "DELETE /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90" status: 204 len: 0 microversion: 2.1 time: 0.131284 Jul 04 10:14:56.806539 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 369/734] 10.222.0.79 () {58 vars in 1238 bytes} [Mon Jul 4 10:14:56 2022] DELETE /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 10:14:56.815305 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-ece7efe2-4eb5-4c08-ae75-c57a42bc1386 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:56.816084 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-ece7efe2-4eb5-4c08-ae75-c57a42bc1386 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:56.822859 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ece7efe2-4eb5-4c08-ae75-c57a42bc1386 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:56.823388 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ece7efe2-4eb5-4c08-ae75-c57a42bc1386 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:56.824189 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ece7efe2-4eb5-4c08-ae75-c57a42bc1386 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:56.824619 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ece7efe2-4eb5-4c08-ae75-c57a42bc1386 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:56.971912 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-ece7efe2-4eb5-4c08-ae75-c57a42bc1386 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:56.980029 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-ece7efe2-4eb5-4c08-ae75-c57a42bc1386 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90" status: 200 len: 1672 microversion: 2.1 time: 0.168680 Jul 04 10:14:56.980590 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 366/735] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:56 2022] GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90 => generated 1672 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:57.295967 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-234fce5f-6105-4984-8c24-d95d6ed07c40 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:57.296908 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-234fce5f-6105-4984-8c24-d95d6ed07c40 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:57.306384 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-234fce5f-6105-4984-8c24-d95d6ed07c40 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:57.306926 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-234fce5f-6105-4984-8c24-d95d6ed07c40 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:57.307688 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-234fce5f-6105-4984-8c24-d95d6ed07c40 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:57.308108 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-234fce5f-6105-4984-8c24-d95d6ed07c40 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:57.368048 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-d9cd1e01-82f7-4758-bb03-4287630b4f6d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:57.372922 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d9cd1e01-82f7-4758-bb03-4287630b4f6d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a16e6a2a-ad39-4e14-9cee-083afb6e9745] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:57.380277 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d9cd1e01-82f7-4758-bb03-4287630b4f6d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:57.380745 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d9cd1e01-82f7-4758-bb03-4287630b4f6d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:57.381481 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d9cd1e01-82f7-4758-bb03-4287630b4f6d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:57.382120 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d9cd1e01-82f7-4758-bb03-4287630b4f6d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:57.419119 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-d9cd1e01-82f7-4758-bb03-4287630b4f6d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054979 Jul 04 10:14:57.420144 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 367/736] 10.222.0.79 () {58 vars in 1301 bytes} [Mon Jul 4 10:14:57 2022] GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:14:57.454004 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-234fce5f-6105-4984-8c24-d95d6ed07c40 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:57.462102 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-234fce5f-6105-4984-8c24-d95d6ed07c40 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1574 microversion: 2.1 time: 0.173573 Jul 04 10:14:57.462779 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 370/737] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:57 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1574 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:57.999154 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e3e7611b-ab99-4953-bc9b-10c6a2c819d2 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:57.999763 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-e3e7611b-ab99-4953-bc9b-10c6a2c819d2 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:58.006266 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e3e7611b-ab99-4953-bc9b-10c6a2c819d2 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:58.006733 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e3e7611b-ab99-4953-bc9b-10c6a2c819d2 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:58.007496 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e3e7611b-ab99-4953-bc9b-10c6a2c819d2 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:58.007922 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e3e7611b-ab99-4953-bc9b-10c6a2c819d2 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:58.145242 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-e3e7611b-ab99-4953-bc9b-10c6a2c819d2 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:58.153425 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-e3e7611b-ab99-4953-bc9b-10c6a2c819d2 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90" status: 200 len: 1672 microversion: 2.1 time: 0.158718 Jul 04 10:14:58.154062 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 368/738] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:57 2022] GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90 => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:58.431178 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-c4f96d1e-09e2-4cf5-9ff3-e5edda2088b1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:58.432020 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-c4f96d1e-09e2-4cf5-9ff3-e5edda2088b1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a16e6a2a-ad39-4e14-9cee-083afb6e9745] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:58.439027 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c4f96d1e-09e2-4cf5-9ff3-e5edda2088b1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:58.439465 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c4f96d1e-09e2-4cf5-9ff3-e5edda2088b1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:58.440218 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c4f96d1e-09e2-4cf5-9ff3-e5edda2088b1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:58.440642 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c4f96d1e-09e2-4cf5-9ff3-e5edda2088b1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:58.472110 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-c4f96d1e-09e2-4cf5-9ff3-e5edda2088b1 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044912 Jul 04 10:14:58.472689 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 371/739] 10.222.0.79 () {58 vars in 1301 bytes} [Mon Jul 4 10:14:58 2022] GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:14:58.480274 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-6f952ca2-3dbe-4749-9350-44842c4f9a75 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:58.480885 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-6f952ca2-3dbe-4749-9350-44842c4f9a75 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:58.487679 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6f952ca2-3dbe-4749-9350-44842c4f9a75 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:58.488129 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6f952ca2-3dbe-4749-9350-44842c4f9a75 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:58.488954 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6f952ca2-3dbe-4749-9350-44842c4f9a75 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:58.489386 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6f952ca2-3dbe-4749-9350-44842c4f9a75 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:58.627895 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-6f952ca2-3dbe-4749-9350-44842c4f9a75 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:58.631380 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:14:58.636990 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-6f952ca2-3dbe-4749-9350-44842c4f9a75 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1574 microversion: 2.1 time: 0.161069 Jul 04 10:14:58.637608 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 369/740] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:58 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:59.003030 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-7a1682c6-627f-4390-8369-6074d1cf5329 req-0f260d1f-97b7-4144-b321-23d3c9aca431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9526d9a-e0e4-4708-a2da-872d57732128", "name": "network-vif-plugged", "status": "completed", "tag": "0561989e-f05a-46b1-a7cf-00085ff7229a"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:14:59.012180 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-7a1682c6-627f-4390-8369-6074d1cf5329 req-0f260d1f-97b7-4144-b321-23d3c9aca431 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:59.012620 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-7a1682c6-627f-4390-8369-6074d1cf5329 req-0f260d1f-97b7-4144-b321-23d3c9aca431 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:59.024456 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-7a1682c6-627f-4390-8369-6074d1cf5329 req-0f260d1f-97b7-4144-b321-23d3c9aca431 service nova] Creating event network-vif-plugged:0561989e-f05a-46b1-a7cf-00085ff7229a for instance f9526d9a-e0e4-4708-a2da-872d57732128 on hv-cinder-84841 Jul 04 10:14:59.030085 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-7a1682c6-627f-4390-8369-6074d1cf5329 req-0f260d1f-97b7-4144-b321-23d3c9aca431 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038825 Jul 04 10:14:59.030910 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 372/741] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 10:14:59.172445 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8f8fb039-e489-4d69-a886-bd6879fe94b2 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:59.173045 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-8f8fb039-e489-4d69-a886-bd6879fe94b2 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:59.180738 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8f8fb039-e489-4d69-a886-bd6879fe94b2 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:59.181194 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8f8fb039-e489-4d69-a886-bd6879fe94b2 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:59.182051 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8f8fb039-e489-4d69-a886-bd6879fe94b2 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:59.182592 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8f8fb039-e489-4d69-a886-bd6879fe94b2 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:59.438155 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-8f8fb039-e489-4d69-a886-bd6879fe94b2 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:59.449563 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-8f8fb039-e489-4d69-a886-bd6879fe94b2 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90" status: 200 len: 1672 microversion: 2.1 time: 0.281188 Jul 04 10:14:59.450183 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 370/742] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:59 2022] GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90 => generated 1672 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:14:59.488229 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-63249b4e-9633-4b21-ae73-c59eb9d639c7 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:59.491720 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-63249b4e-9633-4b21-ae73-c59eb9d639c7 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a16e6a2a-ad39-4e14-9cee-083afb6e9745] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:59.498723 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-63249b4e-9633-4b21-ae73-c59eb9d639c7 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:59.499136 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-63249b4e-9633-4b21-ae73-c59eb9d639c7 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:59.499899 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-63249b4e-9633-4b21-ae73-c59eb9d639c7 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:59.500329 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-63249b4e-9633-4b21-ae73-c59eb9d639c7 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:59.530846 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-63249b4e-9633-4b21-ae73-c59eb9d639c7 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049558 Jul 04 10:14:59.531965 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 373/743] 10.222.0.79 () {58 vars in 1301 bytes} [Mon Jul 4 10:14:59 2022] GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 04 10:14:59.606906 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-16af939e-6659-4b93-a005-b191e10277ce tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:59.607491 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-16af939e-6659-4b93-a005-b191e10277ce tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a16e6a2a-ad39-4e14-9cee-083afb6e9745] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:59.614027 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-16af939e-6659-4b93-a005-b191e10277ce tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:59.614474 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-16af939e-6659-4b93-a005-b191e10277ce tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:59.615238 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-16af939e-6659-4b93-a005-b191e10277ce tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:59.615666 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-16af939e-6659-4b93-a005-b191e10277ce tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:59.643763 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-16af939e-6659-4b93-a005-b191e10277ce tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a16e6a2a-ad39-4e14-9cee-083afb6e9745] Going to try to terminate instance {{(pid=117865) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 10:14:59.655872 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-e45418ec-e580-4b04-8f6a-abe9a7d5ddb6 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:59.656652 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-e45418ec-e580-4b04-8f6a-abe9a7d5ddb6 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:59.663219 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e45418ec-e580-4b04-8f6a-abe9a7d5ddb6 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:59.663662 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e45418ec-e580-4b04-8f6a-abe9a7d5ddb6 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:59.664539 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e45418ec-e580-4b04-8f6a-abe9a7d5ddb6 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:59.665012 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e45418ec-e580-4b04-8f6a-abe9a7d5ddb6 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:59.737478 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-16af939e-6659-4b93-a005-b191e10277ce tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745" status: 204 len: 0 microversion: 2.1 time: 0.135482 Jul 04 10:14:59.741272 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 371/744] 10.222.0.79 () {58 vars in 1238 bytes} [Mon Jul 4 10:14:59 2022] DELETE /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 10:14:59.747133 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e46b41fd-c373-483a-8eed-5045bd53d12d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:14:59.747881 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-e46b41fd-c373-483a-8eed-5045bd53d12d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a16e6a2a-ad39-4e14-9cee-083afb6e9745] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:14:59.755035 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e46b41fd-c373-483a-8eed-5045bd53d12d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:59.755564 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e46b41fd-c373-483a-8eed-5045bd53d12d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:59.756430 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e46b41fd-c373-483a-8eed-5045bd53d12d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:14:59.756951 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e46b41fd-c373-483a-8eed-5045bd53d12d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:14:59.900800 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-e45418ec-e580-4b04-8f6a-abe9a7d5ddb6 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:14:59.909289 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-e45418ec-e580-4b04-8f6a-abe9a7d5ddb6 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1574 microversion: 2.1 time: 0.258423 Jul 04 10:14:59.909823 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 374/745] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:59 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1574 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:15:00.019943 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-e46b41fd-c373-483a-8eed-5045bd53d12d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:00.028136 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-e46b41fd-c373-483a-8eed-5045bd53d12d tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745" status: 200 len: 1680 microversion: 2.1 time: 0.285353 Jul 04 10:15:00.028744 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 372/746] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:14:59 2022] GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745 => generated 1680 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:15:00.105228 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-25281cd2-1719-4787-afa9-8a27103985e5 req-93d5a978-31d2-4da7-a8f2-8bad00e8aef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "383b09a2-bd4d-450c-9be6-413d465e3f90", "name": "network-vif-deleted", "tag": "f3ced8cf-b87b-4d22-b190-3b0019183ff9"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:15:00.118190 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-25281cd2-1719-4787-afa9-8a27103985e5 req-93d5a978-31d2-4da7-a8f2-8bad00e8aef7 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:00.118635 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-25281cd2-1719-4787-afa9-8a27103985e5 req-93d5a978-31d2-4da7-a8f2-8bad00e8aef7 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:00.134220 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-25281cd2-1719-4787-afa9-8a27103985e5 req-93d5a978-31d2-4da7-a8f2-8bad00e8aef7 service nova] Creating event network-vif-deleted:f3ced8cf-b87b-4d22-b190-3b0019183ff9 for instance 383b09a2-bd4d-450c-9be6-413d465e3f90 on hv-cinder-84841 Jul 04 10:15:00.139670 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-25281cd2-1719-4787-afa9-8a27103985e5 req-93d5a978-31d2-4da7-a8f2-8bad00e8aef7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038035 Jul 04 10:15:00.140289 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 375/747] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:15:00.467487 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-d9727d8c-48df-4e07-8da8-771f08f479e1 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:00.468451 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d9727d8c-48df-4e07-8da8-771f08f479e1 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:00.475652 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d9727d8c-48df-4e07-8da8-771f08f479e1 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:00.476185 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d9727d8c-48df-4e07-8da8-771f08f479e1 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:00.477039 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d9727d8c-48df-4e07-8da8-771f08f479e1 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:00.477546 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d9727d8c-48df-4e07-8da8-771f08f479e1 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:00.543333 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-d9727d8c-48df-4e07-8da8-771f08f479e1 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:00.551290 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-d9727d8c-48df-4e07-8da8-771f08f479e1 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90" status: 200 len: 1605 microversion: 2.1 time: 0.088048 Jul 04 10:15:00.560935 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 373/748] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:15:00 2022] GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90 => generated 1605 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:15:00.928329 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-da2da224-d09a-46b5-8402-3431b9514118 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:00.929043 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-da2da224-d09a-46b5-8402-3431b9514118 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:00.937702 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-da2da224-d09a-46b5-8402-3431b9514118 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:00.938143 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-da2da224-d09a-46b5-8402-3431b9514118 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:00.938947 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-da2da224-d09a-46b5-8402-3431b9514118 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:00.939366 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-da2da224-d09a-46b5-8402-3431b9514118 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:01.045748 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-0fa9e693-3824-4e42-806c-09d31f40f8c6 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:01.046331 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-0fa9e693-3824-4e42-806c-09d31f40f8c6 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a16e6a2a-ad39-4e14-9cee-083afb6e9745] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:01.052619 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0fa9e693-3824-4e42-806c-09d31f40f8c6 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:01.053109 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0fa9e693-3824-4e42-806c-09d31f40f8c6 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:01.053851 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0fa9e693-3824-4e42-806c-09d31f40f8c6 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:01.054277 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0fa9e693-3824-4e42-806c-09d31f40f8c6 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:01.100691 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-da2da224-d09a-46b5-8402-3431b9514118 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:01.110698 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-da2da224-d09a-46b5-8402-3431b9514118 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1574 microversion: 2.1 time: 0.187566 Jul 04 10:15:01.114503 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 376/749] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:15:00 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1574 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:15:01.200888 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-0fa9e693-3824-4e42-806c-09d31f40f8c6 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:01.208785 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-0fa9e693-3824-4e42-806c-09d31f40f8c6 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745" status: 200 len: 1680 microversion: 2.1 time: 0.167122 Jul 04 10:15:01.209359 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 374/750] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:15:01 2022] GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:15:01.576306 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-9d9e32e3-7677-491f-b0bf-76b258fa6812 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:01.577471 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-9d9e32e3-7677-491f-b0bf-76b258fa6812 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:01.588394 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9d9e32e3-7677-491f-b0bf-76b258fa6812 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:01.589531 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9d9e32e3-7677-491f-b0bf-76b258fa6812 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:01.590851 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9d9e32e3-7677-491f-b0bf-76b258fa6812 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:01.591833 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9d9e32e3-7677-491f-b0bf-76b258fa6812 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:01.670482 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-9d9e32e3-7677-491f-b0bf-76b258fa6812 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:01.678628 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-9d9e32e3-7677-491f-b0bf-76b258fa6812 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90" status: 200 len: 1322 microversion: 2.1 time: 0.112124 Jul 04 10:15:01.679207 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 377/751] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:15:01 2022] GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90 => generated 1322 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:15:02.131265 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-9a48ee93-b4e2-471f-8a3f-60c1ac4ad0af tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:02.131846 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-9a48ee93-b4e2-471f-8a3f-60c1ac4ad0af tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:02.139447 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9a48ee93-b4e2-471f-8a3f-60c1ac4ad0af tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:02.139883 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9a48ee93-b4e2-471f-8a3f-60c1ac4ad0af tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:02.140649 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9a48ee93-b4e2-471f-8a3f-60c1ac4ad0af tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:02.141065 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9a48ee93-b4e2-471f-8a3f-60c1ac4ad0af tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:02.228903 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-bd9968e8-2d24-4c9f-85e6-1b368ba611b0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:02.229567 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-bd9968e8-2d24-4c9f-85e6-1b368ba611b0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a16e6a2a-ad39-4e14-9cee-083afb6e9745] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:02.236394 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-bd9968e8-2d24-4c9f-85e6-1b368ba611b0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:02.236880 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-bd9968e8-2d24-4c9f-85e6-1b368ba611b0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:02.237682 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-bd9968e8-2d24-4c9f-85e6-1b368ba611b0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:02.238076 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-bd9968e8-2d24-4c9f-85e6-1b368ba611b0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:02.291090 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-9a48ee93-b4e2-471f-8a3f-60c1ac4ad0af tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:02.299773 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-9a48ee93-b4e2-471f-8a3f-60c1ac4ad0af tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1574 microversion: 2.1 time: 0.172477 Jul 04 10:15:02.306636 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 375/752] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:15:02 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1574 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:15:02.423961 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-bd9968e8-2d24-4c9f-85e6-1b368ba611b0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:02.432198 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-bd9968e8-2d24-4c9f-85e6-1b368ba611b0 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745" status: 200 len: 1680 microversion: 2.1 time: 0.207174 Jul 04 10:15:02.442185 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 378/753] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:15:02 2022] GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745 => generated 1680 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:15:02.698479 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-0a598e6c-97e1-4dd8-8e7d-3fbc52d8fa1c tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:02.699223 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-0a598e6c-97e1-4dd8-8e7d-3fbc52d8fa1c tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:02.707533 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0a598e6c-97e1-4dd8-8e7d-3fbc52d8fa1c tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:02.707985 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0a598e6c-97e1-4dd8-8e7d-3fbc52d8fa1c tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:02.709331 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0a598e6c-97e1-4dd8-8e7d-3fbc52d8fa1c tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:02.710624 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0a598e6c-97e1-4dd8-8e7d-3fbc52d8fa1c tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:02.748958 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0a598e6c-97e1-4dd8-8e7d-3fbc52d8fa1c tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:02.749550 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0a598e6c-97e1-4dd8-8e7d-3fbc52d8fa1c tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:02.750395 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.objects.instance [None req-0a598e6c-97e1-4dd8-8e7d-3fbc52d8fa1c tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lazy-loading 'fault' on Instance uuid 383b09a2-bd4d-450c-9be6-413d465e3f90 {{(pid=117865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 10:15:02.813341 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-0a598e6c-97e1-4dd8-8e7d-3fbc52d8fa1c tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba262d439a4253bf1c2c0f114d0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f559cbed35f4fbb8fe71906696733e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:02.820445 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-0a598e6c-97e1-4dd8-8e7d-3fbc52d8fa1c tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90" status: 200 len: 1327 microversion: 2.1 time: 0.125919 Jul 04 10:15:02.822269 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 376/754] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:15:02 2022] GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90 => generated 1327 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:15:03.317158 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-77a79744-ca90-46b4-889b-fa563fe95790 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:03.317834 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-77a79744-ca90-46b4-889b-fa563fe95790 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:03.325293 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-77a79744-ca90-46b4-889b-fa563fe95790 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:03.325783 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-77a79744-ca90-46b4-889b-fa563fe95790 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:03.326564 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-77a79744-ca90-46b4-889b-fa563fe95790 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:03.326957 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-77a79744-ca90-46b4-889b-fa563fe95790 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:03.450191 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-78ee1581-c9b7-467a-ac40-c959724b480f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:03.450798 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-78ee1581-c9b7-467a-ac40-c959724b480f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a16e6a2a-ad39-4e14-9cee-083afb6e9745] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:03.459132 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-78ee1581-c9b7-467a-ac40-c959724b480f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:03.460074 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-78ee1581-c9b7-467a-ac40-c959724b480f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:03.461111 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-78ee1581-c9b7-467a-ac40-c959724b480f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:03.461754 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-78ee1581-c9b7-467a-ac40-c959724b480f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:03.574562 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-78ee1581-c9b7-467a-ac40-c959724b480f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2351fc3b74ef5a530fded1be6b997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57f93d66f534107a228d908afa64890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:03.577735 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-77a79744-ca90-46b4-889b-fa563fe95790 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:03.582846 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-78ee1581-c9b7-467a-ac40-c959724b480f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745" status: 200 len: 1613 microversion: 2.1 time: 0.136620 Jul 04 10:15:03.587579 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-77a79744-ca90-46b4-889b-fa563fe95790 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1561 microversion: 2.1 time: 0.274292 Jul 04 10:15:03.588171 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 379/755] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:15:03 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1561 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:15:03.593276 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-55db2836-36cf-4f1c-a939-2de6b7d9397c req-e0a2e4be-91a0-4de5-a717-aa2098d7a063 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a16e6a2a-ad39-4e14-9cee-083afb6e9745", "name": "network-vif-deleted", "tag": "346feb22-2463-46f6-a88c-27348c0b1dcf"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:15:03.594913 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 377/756] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:15:03 2022] GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745 => generated 1613 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:15:03.603882 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-55db2836-36cf-4f1c-a939-2de6b7d9397c req-e0a2e4be-91a0-4de5-a717-aa2098d7a063 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:03.604315 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-55db2836-36cf-4f1c-a939-2de6b7d9397c req-e0a2e4be-91a0-4de5-a717-aa2098d7a063 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:03.616749 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-55db2836-36cf-4f1c-a939-2de6b7d9397c req-e0a2e4be-91a0-4de5-a717-aa2098d7a063 service nova] Creating event network-vif-deleted:346feb22-2463-46f6-a88c-27348c0b1dcf for instance a16e6a2a-ad39-4e14-9cee-083afb6e9745 on hv-cinder-84841 Jul 04 10:15:03.622292 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-55db2836-36cf-4f1c-a939-2de6b7d9397c req-e0a2e4be-91a0-4de5-a717-aa2098d7a063 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032240 Jul 04 10:15:03.622912 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 380/757] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:15:03.838987 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b8ae36d5-e971-4e9a-bbde-79d58a00e60b tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:03.839616 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-b8ae36d5-e971-4e9a-bbde-79d58a00e60b tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:03.846026 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b8ae36d5-e971-4e9a-bbde-79d58a00e60b tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:03.846477 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b8ae36d5-e971-4e9a-bbde-79d58a00e60b tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:03.847247 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b8ae36d5-e971-4e9a-bbde-79d58a00e60b tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:03.847685 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b8ae36d5-e971-4e9a-bbde-79d58a00e60b tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:03.861830 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-b8ae36d5-e971-4e9a-bbde-79d58a00e60b tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] HTTP exception thrown: Instance 383b09a2-bd4d-450c-9be6-413d465e3f90 could not be found. Jul 04 10:15:03.863512 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b8ae36d5-e971-4e9a-bbde-79d58a00e60b tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Request method failure captured: Jul 04 10:15:03.863512 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: request: GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90 HTTP/1.1 Jul 04 10:15:03.863512 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept: application/json Jul 04 10:15:03.863512 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept-Encoding: identity Jul 04 10:15:03.863512 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Connection: close Jul 04 10:15:03.863512 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Length: 0 Jul 04 10:15:03.863512 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Type: application/json Jul 04 10:15:03.863512 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Host: 10.222.0.79 Jul 04 10:15:03.863512 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 04 10:15:03.863512 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 04 10:15:03.863512 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Auth-Token: gAAAAABiwrwqqpSzXCz6TI7i3v3Q0Ikv6eP5G-aFeEx1FMOX4uF8_xFSEGq1OvsjmphPPgrV_LZ7ApTiSGpB_p8ebTXPQypjNBbmCiLNfN6Vw7ly4_fGoJrpUrTq3Bgn-HxcRgFMGj02UI8_qzoahUfhl7siMEcN-dAFCb5QyOQ3C5VA-l3wHp4 Jul 04 10:15:03.863512 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Id: None Jul 04 10:15:03.863512 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Name: None Jul 04 10:15:03.863512 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 04 10:15:03.863512 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 04 10:15:03.863512 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 04 10:15:03.863512 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 04 10:15:03.863512 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Id: 2f559cbed35f4fbb8fe71906696733e7 Jul 04 10:15:03.863512 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Name: tempest-AttachVolumeTestJSON-439716941 Jul 04 10:15:03.863512 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Role: reader,member Jul 04 10:15:03.863512 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Roles: reader,member Jul 04 10:15:03.865388 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2f559cbed35f4fbb8fe71906696733e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2f559cbed35f4fbb8fe71906696733e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2f559cbed35f4fbb8fe71906696733e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2f559cbed35f4fbb8fe71906696733e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:15:03.865388 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant: tempest-AttachVolumeTestJSON-439716941 Jul 04 10:15:03.865388 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Id: 2f559cbed35f4fbb8fe71906696733e7 Jul 04 10:15:03.865388 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Name: tempest-AttachVolumeTestJSON-439716941 Jul 04 10:15:03.865388 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User: tempest-AttachVolumeTestJSON-439716941-project Jul 04 10:15:03.865388 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 04 10:15:03.865388 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 04 10:15:03.865388 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Id: dfba262d439a4253bf1c2c0f114d0cdc Jul 04 10:15:03.865388 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Name: tempest-AttachVolumeTestJSON-439716941-project Jul 04 10:15:03.865388 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: method: > Jul 04 10:15:03.865388 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: exception: Instance 383b09a2-bd4d-450c-9be6-413d465e3f90 could not be found. Jul 04 10:15:03.865388 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: action_args: {'id': '383b09a2-bd4d-450c-9be6-413d465e3f90'} Jul 04 10:15:03.866271 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:15:03.866271 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:03.866271 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:15:03.866271 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:15:03.866271 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:15:03.866271 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:15:03.866271 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:15:03.866271 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:15:03.866271 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:15:03.866271 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:15:03.866271 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 383b09a2-bd4d-450c-9be6-413d465e3f90 could not be found. Jul 04 10:15:03.866271 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:03.866271 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:03.866271 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:03.866271 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:03.866271 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:03.866271 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:03.866271 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:15:03.866271 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:15:03.866271 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:15:03.867772 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:15:03.867772 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 10:15:03.867772 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 10:15:03.867772 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:15:03.867772 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:15:03.867772 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:15:03.867772 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:15:03.867772 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 383b09a2-bd4d-450c-9be6-413d465e3f90 could not be found. Jul 04 10:15:03.867772 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:03.867772 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:03.867772 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:03.867772 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:03.867772 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:03.867772 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:03.867772 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:15:03.867772 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:15:03.867772 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 383b09a2-bd4d-450c-9be6-413d465e3f90 could not be found. Jul 04 10:15:03.867772 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:03.869037 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b8ae36d5-e971-4e9a-bbde-79d58a00e60b tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Returning 404 to user: Instance 383b09a2-bd4d-450c-9be6-413d465e3f90 could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:15:03.869037 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-b8ae36d5-e971-4e9a-bbde-79d58a00e60b tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90" status: 404 len: 111 microversion: 2.1 time: 0.030267 Jul 04 10:15:03.869037 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 378/758] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:15:03 2022] GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:15:03.874910 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-d172f80a-1f1e-4a1d-9a8f-12e54c08c9e6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '.version_select at 0x7f2802fca9d0>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:03.897859 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-d172f80a-1f1e-4a1d-9a8f-12e54c08c9e6 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1509875066" status: 202 len: 0 microversion: 2.1 time: 0.027049 Jul 04 10:15:03.898552 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 381/759] 10.222.0.79 () {58 vars in 1220 bytes} [Mon Jul 4 10:15:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1509875066 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 10:15:04.602951 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-97d87244-3ca5-4b5d-abee-6a8dae5870c8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:04.604376 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-97d87244-3ca5-4b5d-abee-6a8dae5870c8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a16e6a2a-ad39-4e14-9cee-083afb6e9745] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:04.611572 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-97d87244-3ca5-4b5d-abee-6a8dae5870c8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:04.612135 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-97d87244-3ca5-4b5d-abee-6a8dae5870c8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:04.613014 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-97d87244-3ca5-4b5d-abee-6a8dae5870c8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:04.613674 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-97d87244-3ca5-4b5d-abee-6a8dae5870c8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:04.629242 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-97d87244-3ca5-4b5d-abee-6a8dae5870c8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] HTTP exception thrown: Instance a16e6a2a-ad39-4e14-9cee-083afb6e9745 could not be found. Jul 04 10:15:04.637065 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-97d87244-3ca5-4b5d-abee-6a8dae5870c8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Request method failure captured: Jul 04 10:15:04.637065 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: request: GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745 HTTP/1.1 Jul 04 10:15:04.637065 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept: application/json Jul 04 10:15:04.637065 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept-Encoding: identity Jul 04 10:15:04.637065 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Connection: close Jul 04 10:15:04.637065 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Length: 0 Jul 04 10:15:04.637065 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Type: application/json Jul 04 10:15:04.637065 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Host: 10.222.0.79 Jul 04 10:15:04.637065 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 04 10:15:04.637065 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 04 10:15:04.637065 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Auth-Token: gAAAAABiwrwvD9yiGE4pStEGBF2Ys-pryu1tx1k2auUnE0PRvpPvnRtEQEaHpqZQ8egutal5ICM4nB9U9UkZUlVAaFmujyok7-zJ_4u8OoD2UCOlqV-Oyun1vIdrrzMPcAwbXsLkKDns-0TZYcaWBDNIYObNG0qh5NpdFBBI5iioapUAgXk4vDM Jul 04 10:15:04.637065 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Id: None Jul 04 10:15:04.637065 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Name: None Jul 04 10:15:04.637065 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 04 10:15:04.637065 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 04 10:15:04.637065 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 04 10:15:04.637065 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 04 10:15:04.637065 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Id: a57f93d66f534107a228d908afa64890 Jul 04 10:15:04.637065 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Name: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:15:04.637065 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Role: reader,member Jul 04 10:15:04.637065 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Roles: reader,member Jul 04 10:15:04.638838 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a57f93d66f534107a228d908afa64890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a57f93d66f534107a228d908afa64890"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a57f93d66f534107a228d908afa64890"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a57f93d66f534107a228d908afa64890"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:15:04.638838 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:15:04.638838 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Id: a57f93d66f534107a228d908afa64890 Jul 04 10:15:04.638838 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:15:04.638838 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User: tempest-AttachVolumeNegativeTest-223944498-project Jul 04 10:15:04.638838 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 04 10:15:04.638838 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 04 10:15:04.638838 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Id: 88d2351fc3b74ef5a530fded1be6b997 Jul 04 10:15:04.638838 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Name: tempest-AttachVolumeNegativeTest-223944498-project Jul 04 10:15:04.638838 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: method: > Jul 04 10:15:04.638838 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: exception: Instance a16e6a2a-ad39-4e14-9cee-083afb6e9745 could not be found. Jul 04 10:15:04.638838 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: action_args: {'id': 'a16e6a2a-ad39-4e14-9cee-083afb6e9745'} Jul 04 10:15:04.639738 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:15:04.639738 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:04.639738 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:15:04.639738 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:15:04.639738 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:15:04.639738 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:15:04.639738 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:15:04.639738 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:15:04.639738 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:15:04.639738 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:15:04.639738 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a16e6a2a-ad39-4e14-9cee-083afb6e9745 could not be found. Jul 04 10:15:04.639738 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:04.639738 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:04.639738 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:04.639738 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:04.639738 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:04.639738 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:04.639738 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:15:04.639738 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:15:04.639738 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:15:04.641159 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:15:04.641159 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 10:15:04.641159 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 10:15:04.641159 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:15:04.641159 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:15:04.641159 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:15:04.641159 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:15:04.641159 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a16e6a2a-ad39-4e14-9cee-083afb6e9745 could not be found. Jul 04 10:15:04.641159 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:04.641159 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:04.641159 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:04.641159 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:04.641159 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:04.641159 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:04.641159 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:15:04.641159 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:15:04.641159 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a16e6a2a-ad39-4e14-9cee-083afb6e9745 could not be found. Jul 04 10:15:04.641159 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:04.642763 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-97d87244-3ca5-4b5d-abee-6a8dae5870c8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Returning 404 to user: Instance a16e6a2a-ad39-4e14-9cee-083afb6e9745 could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:15:04.642763 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-97d87244-3ca5-4b5d-abee-6a8dae5870c8 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745" status: 404 len: 111 microversion: 2.1 time: 0.042170 Jul 04 10:15:04.645265 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 379/760] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:15:04 2022] GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:15:04.651054 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-1324874c-3dd8-4004-86f3-ecbe21ec4edd tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '.version_select at 0x7f2802fdaee0>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:04.672111 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-1324874c-3dd8-4004-86f3-ecbe21ec4edd tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-377818341" status: 202 len: 0 microversion: 2.1 time: 0.025528 Jul 04 10:15:04.673220 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 382/761] 10.222.0.79 () {58 vars in 1217 bytes} [Mon Jul 4 10:15:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-377818341 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 10:15:06.466236 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-522dfa9b-2c80-40fb-b9a9-2ba58234358f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:06.466805 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-522dfa9b-2c80-40fb-b9a9-2ba58234358f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a16e6a2a-ad39-4e14-9cee-083afb6e9745] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:06.474118 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-522dfa9b-2c80-40fb-b9a9-2ba58234358f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:06.474568 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-522dfa9b-2c80-40fb-b9a9-2ba58234358f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:06.475330 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-522dfa9b-2c80-40fb-b9a9-2ba58234358f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:06.475765 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-522dfa9b-2c80-40fb-b9a9-2ba58234358f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:06.489653 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-522dfa9b-2c80-40fb-b9a9-2ba58234358f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] HTTP exception thrown: Instance a16e6a2a-ad39-4e14-9cee-083afb6e9745 could not be found. Jul 04 10:15:06.491238 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-522dfa9b-2c80-40fb-b9a9-2ba58234358f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Request method failure captured: Jul 04 10:15:06.491238 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: request: DELETE /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745 HTTP/1.1 Jul 04 10:15:06.491238 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept: application/json Jul 04 10:15:06.491238 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept-Encoding: identity Jul 04 10:15:06.491238 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Connection: close Jul 04 10:15:06.491238 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Length: 0 Jul 04 10:15:06.491238 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Type: application/json Jul 04 10:15:06.491238 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Host: 10.222.0.79 Jul 04 10:15:06.491238 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 04 10:15:06.491238 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 04 10:15:06.491238 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Auth-Token: gAAAAABiwrwvD9yiGE4pStEGBF2Ys-pryu1tx1k2auUnE0PRvpPvnRtEQEaHpqZQ8egutal5ICM4nB9U9UkZUlVAaFmujyok7-zJ_4u8OoD2UCOlqV-Oyun1vIdrrzMPcAwbXsLkKDns-0TZYcaWBDNIYObNG0qh5NpdFBBI5iioapUAgXk4vDM Jul 04 10:15:06.491238 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Id: None Jul 04 10:15:06.491238 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Name: None Jul 04 10:15:06.491238 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 04 10:15:06.491238 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 04 10:15:06.491238 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 04 10:15:06.491238 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 04 10:15:06.491238 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Id: a57f93d66f534107a228d908afa64890 Jul 04 10:15:06.491238 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Name: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:15:06.491238 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Role: reader,member Jul 04 10:15:06.491238 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Roles: reader,member Jul 04 10:15:06.492549 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a57f93d66f534107a228d908afa64890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a57f93d66f534107a228d908afa64890"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a57f93d66f534107a228d908afa64890"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a57f93d66f534107a228d908afa64890"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:15:06.492549 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:15:06.492549 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Id: a57f93d66f534107a228d908afa64890 Jul 04 10:15:06.492549 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:15:06.492549 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User: tempest-AttachVolumeNegativeTest-223944498-project Jul 04 10:15:06.492549 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 04 10:15:06.492549 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 04 10:15:06.492549 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Id: 88d2351fc3b74ef5a530fded1be6b997 Jul 04 10:15:06.492549 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Name: tempest-AttachVolumeNegativeTest-223944498-project Jul 04 10:15:06.492549 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: method: > Jul 04 10:15:06.492549 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: exception: Instance a16e6a2a-ad39-4e14-9cee-083afb6e9745 could not be found. Jul 04 10:15:06.492549 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: action_args: {'id': 'a16e6a2a-ad39-4e14-9cee-083afb6e9745'} Jul 04 10:15:06.493355 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:15:06.493355 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:06.493355 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:15:06.493355 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:15:06.493355 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:15:06.493355 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:15:06.493355 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:15:06.493355 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:15:06.493355 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:15:06.493355 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:15:06.493355 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a16e6a2a-ad39-4e14-9cee-083afb6e9745 could not be found. Jul 04 10:15:06.493355 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:06.493355 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:06.493355 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:06.493355 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:06.493355 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:06.493355 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:06.493355 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:15:06.493355 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:15:06.493355 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:15:06.494708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:15:06.494708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 10:15:06.494708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 10:15:06.494708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 10:15:06.494708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 10:15:06.494708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:15:06.494708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:15:06.494708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:15:06.494708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:15:06.494708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a16e6a2a-ad39-4e14-9cee-083afb6e9745 could not be found. Jul 04 10:15:06.494708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:06.494708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:06.494708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:06.494708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:06.494708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:06.494708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:06.494708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:15:06.494708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:15:06.494708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a16e6a2a-ad39-4e14-9cee-083afb6e9745 could not be found. Jul 04 10:15:06.494708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:06.495939 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-522dfa9b-2c80-40fb-b9a9-2ba58234358f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Returning 404 to user: Instance a16e6a2a-ad39-4e14-9cee-083afb6e9745 could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:15:06.495939 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-522dfa9b-2c80-40fb-b9a9-2ba58234358f tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745" status: 404 len: 111 microversion: 2.1 time: 0.030858 Jul 04 10:15:06.495939 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 380/762] 10.222.0.79 () {58 vars in 1238 bytes} [Mon Jul 4 10:15:06 2022] DELETE /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:15:06.501950 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-8372c901-5f34-4f80-a2cc-941578d704ac tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:06.502693 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-8372c901-5f34-4f80-a2cc-941578d704ac tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a16e6a2a-ad39-4e14-9cee-083afb6e9745] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:06.510097 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8372c901-5f34-4f80-a2cc-941578d704ac tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:06.510540 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8372c901-5f34-4f80-a2cc-941578d704ac tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:06.511298 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8372c901-5f34-4f80-a2cc-941578d704ac tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:06.511726 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8372c901-5f34-4f80-a2cc-941578d704ac tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:06.525413 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.wsgi [None req-8372c901-5f34-4f80-a2cc-941578d704ac tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] HTTP exception thrown: Instance a16e6a2a-ad39-4e14-9cee-083afb6e9745 could not be found. Jul 04 10:15:06.527137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-8372c901-5f34-4f80-a2cc-941578d704ac tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Request method failure captured: Jul 04 10:15:06.527137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: request: GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745 HTTP/1.1 Jul 04 10:15:06.527137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept: application/json Jul 04 10:15:06.527137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept-Encoding: identity Jul 04 10:15:06.527137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Connection: close Jul 04 10:15:06.527137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Length: 0 Jul 04 10:15:06.527137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Type: application/json Jul 04 10:15:06.527137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Host: 10.222.0.79 Jul 04 10:15:06.527137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Openstack-System-Scope: None Jul 04 10:15:06.527137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: User-Agent: python-urllib3/1.26.9 Jul 04 10:15:06.527137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Auth-Token: gAAAAABiwrwvD9yiGE4pStEGBF2Ys-pryu1tx1k2auUnE0PRvpPvnRtEQEaHpqZQ8egutal5ICM4nB9U9UkZUlVAaFmujyok7-zJ_4u8OoD2UCOlqV-Oyun1vIdrrzMPcAwbXsLkKDns-0TZYcaWBDNIYObNG0qh5NpdFBBI5iioapUAgXk4vDM Jul 04 10:15:06.527137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Id: None Jul 04 10:15:06.527137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Name: None Jul 04 10:15:06.527137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Identity-Status: Confirmed Jul 04 10:15:06.527137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Is-Admin-Project: True Jul 04 10:15:06.527137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Id: default Jul 04 10:15:06.527137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Name: Default Jul 04 10:15:06.527137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Id: a57f93d66f534107a228d908afa64890 Jul 04 10:15:06.527137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Name: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:15:06.527137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Role: reader,member Jul 04 10:15:06.527137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Roles: reader,member Jul 04 10:15:06.528593 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a57f93d66f534107a228d908afa64890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a57f93d66f534107a228d908afa64890"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a57f93d66f534107a228d908afa64890"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a57f93d66f534107a228d908afa64890"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:15:06.528593 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:15:06.528593 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Id: a57f93d66f534107a228d908afa64890 Jul 04 10:15:06.528593 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:15:06.528593 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User: tempest-AttachVolumeNegativeTest-223944498-project Jul 04 10:15:06.528593 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Id: default Jul 04 10:15:06.528593 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Name: Default Jul 04 10:15:06.528593 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Id: 88d2351fc3b74ef5a530fded1be6b997 Jul 04 10:15:06.528593 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Name: tempest-AttachVolumeNegativeTest-223944498-project Jul 04 10:15:06.528593 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: method: > Jul 04 10:15:06.528593 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: exception: Instance a16e6a2a-ad39-4e14-9cee-083afb6e9745 could not be found. Jul 04 10:15:06.528593 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: action_args: {'id': 'a16e6a2a-ad39-4e14-9cee-083afb6e9745'} Jul 04 10:15:06.531078 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:15:06.531078 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:06.531078 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:15:06.531078 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:15:06.531078 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:15:06.531078 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:15:06.531078 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:15:06.531078 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:15:06.531078 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:15:06.531078 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:15:06.531078 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a16e6a2a-ad39-4e14-9cee-083afb6e9745 could not be found. Jul 04 10:15:06.531078 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:06.531078 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:06.531078 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:06.531078 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:06.531078 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:06.531078 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:06.531078 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:15:06.531078 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:15:06.531078 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:15:06.532573 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:15:06.532573 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 10:15:06.532573 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 10:15:06.532573 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:15:06.532573 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:15:06.532573 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:15:06.532573 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:15:06.532573 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a16e6a2a-ad39-4e14-9cee-083afb6e9745 could not be found. Jul 04 10:15:06.532573 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:06.532573 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:06.532573 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:06.532573 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:06.532573 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:06.532573 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:06.532573 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:15:06.532573 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:15:06.532573 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a16e6a2a-ad39-4e14-9cee-083afb6e9745 could not be found. Jul 04 10:15:06.532573 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:06.533857 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-8372c901-5f34-4f80-a2cc-941578d704ac tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Returning 404 to user: Instance a16e6a2a-ad39-4e14-9cee-083afb6e9745 could not be found. {{(pid=117866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:15:06.533857 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-8372c901-5f34-4f80-a2cc-941578d704ac tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745" status: 404 len: 111 microversion: 2.1 time: 0.031118 Jul 04 10:15:06.533857 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 383/763] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:15:06 2022] GET /compute/v2.1/servers/a16e6a2a-ad39-4e14-9cee-083afb6e9745 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:15:06.855617 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-ab9c3b8e-5c4e-46f2-8ab8-3cf90d86df62 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:06.856657 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-ab9c3b8e-5c4e-46f2-8ab8-3cf90d86df62 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:06.863539 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ab9c3b8e-5c4e-46f2-8ab8-3cf90d86df62 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:06.864301 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ab9c3b8e-5c4e-46f2-8ab8-3cf90d86df62 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:06.865193 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ab9c3b8e-5c4e-46f2-8ab8-3cf90d86df62 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:06.865646 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ab9c3b8e-5c4e-46f2-8ab8-3cf90d86df62 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:06.880122 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-ab9c3b8e-5c4e-46f2-8ab8-3cf90d86df62 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] HTTP exception thrown: Instance 383b09a2-bd4d-450c-9be6-413d465e3f90 could not be found. Jul 04 10:15:06.881695 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-ab9c3b8e-5c4e-46f2-8ab8-3cf90d86df62 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Request method failure captured: Jul 04 10:15:06.881695 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: request: DELETE /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90 HTTP/1.1 Jul 04 10:15:06.881695 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept: application/json Jul 04 10:15:06.881695 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept-Encoding: identity Jul 04 10:15:06.881695 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Connection: close Jul 04 10:15:06.881695 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Length: 0 Jul 04 10:15:06.881695 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Type: application/json Jul 04 10:15:06.881695 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Host: 10.222.0.79 Jul 04 10:15:06.881695 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 04 10:15:06.881695 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 04 10:15:06.881695 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Auth-Token: gAAAAABiwrwqqpSzXCz6TI7i3v3Q0Ikv6eP5G-aFeEx1FMOX4uF8_xFSEGq1OvsjmphPPgrV_LZ7ApTiSGpB_p8ebTXPQypjNBbmCiLNfN6Vw7ly4_fGoJrpUrTq3Bgn-HxcRgFMGj02UI8_qzoahUfhl7siMEcN-dAFCb5QyOQ3C5VA-l3wHp4 Jul 04 10:15:06.881695 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Id: None Jul 04 10:15:06.881695 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Name: None Jul 04 10:15:06.881695 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 04 10:15:06.881695 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 04 10:15:06.881695 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 04 10:15:06.881695 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 04 10:15:06.881695 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Id: 2f559cbed35f4fbb8fe71906696733e7 Jul 04 10:15:06.881695 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Name: tempest-AttachVolumeTestJSON-439716941 Jul 04 10:15:06.881695 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Role: reader,member Jul 04 10:15:06.881695 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Roles: reader,member Jul 04 10:15:06.883250 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2f559cbed35f4fbb8fe71906696733e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2f559cbed35f4fbb8fe71906696733e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2f559cbed35f4fbb8fe71906696733e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2f559cbed35f4fbb8fe71906696733e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:15:06.883250 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant: tempest-AttachVolumeTestJSON-439716941 Jul 04 10:15:06.883250 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Id: 2f559cbed35f4fbb8fe71906696733e7 Jul 04 10:15:06.883250 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Name: tempest-AttachVolumeTestJSON-439716941 Jul 04 10:15:06.883250 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User: tempest-AttachVolumeTestJSON-439716941-project Jul 04 10:15:06.883250 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 04 10:15:06.883250 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 04 10:15:06.883250 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Id: dfba262d439a4253bf1c2c0f114d0cdc Jul 04 10:15:06.883250 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Name: tempest-AttachVolumeTestJSON-439716941-project Jul 04 10:15:06.883250 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: method: > Jul 04 10:15:06.883250 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: exception: Instance 383b09a2-bd4d-450c-9be6-413d465e3f90 could not be found. Jul 04 10:15:06.883250 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: action_args: {'id': '383b09a2-bd4d-450c-9be6-413d465e3f90'} Jul 04 10:15:06.884143 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:15:06.884143 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:06.884143 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:15:06.884143 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:15:06.884143 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:15:06.884143 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:15:06.884143 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:15:06.884143 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:15:06.884143 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:15:06.884143 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:15:06.884143 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 383b09a2-bd4d-450c-9be6-413d465e3f90 could not be found. Jul 04 10:15:06.884143 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:06.884143 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:06.884143 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:06.884143 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:06.884143 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:06.884143 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:06.884143 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:15:06.884143 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:15:06.884143 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:15:06.885494 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:15:06.885494 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 10:15:06.885494 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 10:15:06.885494 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 10:15:06.885494 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 10:15:06.885494 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:15:06.885494 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:15:06.885494 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:15:06.885494 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:15:06.885494 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 383b09a2-bd4d-450c-9be6-413d465e3f90 could not be found. Jul 04 10:15:06.885494 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:06.885494 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:06.885494 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:06.885494 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:06.885494 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:06.885494 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:06.885494 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:15:06.885494 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:15:06.885494 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 383b09a2-bd4d-450c-9be6-413d465e3f90 could not be found. Jul 04 10:15:06.885494 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:06.886960 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-ab9c3b8e-5c4e-46f2-8ab8-3cf90d86df62 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Returning 404 to user: Instance 383b09a2-bd4d-450c-9be6-413d465e3f90 could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:15:06.886960 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-ab9c3b8e-5c4e-46f2-8ab8-3cf90d86df62 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "DELETE /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90" status: 404 len: 111 microversion: 2.1 time: 0.031620 Jul 04 10:15:06.886960 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 381/764] 10.222.0.79 () {58 vars in 1238 bytes} [Mon Jul 4 10:15:06 2022] DELETE /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 04 10:15:06.891913 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-ae080581-64c4-4ec7-bf01-c0eaa904a57d tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:06.892529 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-ae080581-64c4-4ec7-bf01-c0eaa904a57d tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: 383b09a2-bd4d-450c-9be6-413d465e3f90] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:06.899641 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ae080581-64c4-4ec7-bf01-c0eaa904a57d tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:06.900086 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ae080581-64c4-4ec7-bf01-c0eaa904a57d tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:06.900842 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ae080581-64c4-4ec7-bf01-c0eaa904a57d tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:06.901276 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ae080581-64c4-4ec7-bf01-c0eaa904a57d tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:06.914963 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.wsgi [None req-ae080581-64c4-4ec7-bf01-c0eaa904a57d tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] HTTP exception thrown: Instance 383b09a2-bd4d-450c-9be6-413d465e3f90 could not be found. Jul 04 10:15:06.916475 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-ae080581-64c4-4ec7-bf01-c0eaa904a57d tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Request method failure captured: Jul 04 10:15:06.916475 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: request: GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90 HTTP/1.1 Jul 04 10:15:06.916475 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept: application/json Jul 04 10:15:06.916475 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept-Encoding: identity Jul 04 10:15:06.916475 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Connection: close Jul 04 10:15:06.916475 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Length: 0 Jul 04 10:15:06.916475 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Type: application/json Jul 04 10:15:06.916475 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Host: 10.222.0.79 Jul 04 10:15:06.916475 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Openstack-System-Scope: None Jul 04 10:15:06.916475 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: User-Agent: python-urllib3/1.26.9 Jul 04 10:15:06.916475 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Auth-Token: gAAAAABiwrwqqpSzXCz6TI7i3v3Q0Ikv6eP5G-aFeEx1FMOX4uF8_xFSEGq1OvsjmphPPgrV_LZ7ApTiSGpB_p8ebTXPQypjNBbmCiLNfN6Vw7ly4_fGoJrpUrTq3Bgn-HxcRgFMGj02UI8_qzoahUfhl7siMEcN-dAFCb5QyOQ3C5VA-l3wHp4 Jul 04 10:15:06.916475 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Id: None Jul 04 10:15:06.916475 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Name: None Jul 04 10:15:06.916475 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Identity-Status: Confirmed Jul 04 10:15:06.916475 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Is-Admin-Project: True Jul 04 10:15:06.916475 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Id: default Jul 04 10:15:06.916475 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Name: Default Jul 04 10:15:06.916475 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Id: 2f559cbed35f4fbb8fe71906696733e7 Jul 04 10:15:06.916475 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Name: tempest-AttachVolumeTestJSON-439716941 Jul 04 10:15:06.916475 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Role: reader,member Jul 04 10:15:06.916475 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Roles: reader,member Jul 04 10:15:06.918090 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2f559cbed35f4fbb8fe71906696733e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2f559cbed35f4fbb8fe71906696733e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2f559cbed35f4fbb8fe71906696733e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2f559cbed35f4fbb8fe71906696733e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:15:06.918090 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant: tempest-AttachVolumeTestJSON-439716941 Jul 04 10:15:06.918090 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Id: 2f559cbed35f4fbb8fe71906696733e7 Jul 04 10:15:06.918090 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Name: tempest-AttachVolumeTestJSON-439716941 Jul 04 10:15:06.918090 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User: tempest-AttachVolumeTestJSON-439716941-project Jul 04 10:15:06.918090 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Id: default Jul 04 10:15:06.918090 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Name: Default Jul 04 10:15:06.918090 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Id: dfba262d439a4253bf1c2c0f114d0cdc Jul 04 10:15:06.918090 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Name: tempest-AttachVolumeTestJSON-439716941-project Jul 04 10:15:06.918090 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: method: > Jul 04 10:15:06.918090 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: exception: Instance 383b09a2-bd4d-450c-9be6-413d465e3f90 could not be found. Jul 04 10:15:06.918090 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: action_args: {'id': '383b09a2-bd4d-450c-9be6-413d465e3f90'} Jul 04 10:15:06.918954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:15:06.918954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:06.918954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:15:06.918954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:15:06.918954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:15:06.918954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:15:06.918954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:15:06.918954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:15:06.918954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:15:06.918954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:15:06.918954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 383b09a2-bd4d-450c-9be6-413d465e3f90 could not be found. Jul 04 10:15:06.918954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:06.918954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:06.918954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:06.918954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:06.918954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:06.918954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:06.918954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:15:06.918954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:15:06.918954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:15:06.920380 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:15:06.920380 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 10:15:06.920380 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 10:15:06.920380 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:15:06.920380 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:15:06.920380 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:15:06.920380 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:15:06.920380 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 383b09a2-bd4d-450c-9be6-413d465e3f90 could not be found. Jul 04 10:15:06.920380 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:06.920380 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:06.920380 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:06.920380 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:06.920380 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:06.920380 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:06.920380 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:15:06.920380 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:15:06.920380 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 383b09a2-bd4d-450c-9be6-413d465e3f90 could not be found. Jul 04 10:15:06.920380 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:06.921876 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-ae080581-64c4-4ec7-bf01-c0eaa904a57d tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Returning 404 to user: Instance 383b09a2-bd4d-450c-9be6-413d465e3f90 could not be found. {{(pid=117866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:15:06.921876 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-ae080581-64c4-4ec7-bf01-c0eaa904a57d tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90" status: 404 len: 111 microversion: 2.1 time: 0.029852 Jul 04 10:15:06.921876 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 384/765] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:15:06 2022] GET /compute/v2.1/servers/383b09a2-bd4d-450c-9be6-413d465e3f90 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:15:07.690926 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8ad32bbb-6ba6-4426-b235-4a5edd5ed7bf tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:07.691479 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-8ad32bbb-6ba6-4426-b235-4a5edd5ed7bf tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a936822b-ef8c-42ad-9510-194756830a00] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:07.698158 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8ad32bbb-6ba6-4426-b235-4a5edd5ed7bf tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:07.698591 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8ad32bbb-6ba6-4426-b235-4a5edd5ed7bf tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:07.699358 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8ad32bbb-6ba6-4426-b235-4a5edd5ed7bf tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:07.699826 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8ad32bbb-6ba6-4426-b235-4a5edd5ed7bf tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:07.715100 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-8ad32bbb-6ba6-4426-b235-4a5edd5ed7bf tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] HTTP exception thrown: Instance a936822b-ef8c-42ad-9510-194756830a00 could not be found. Jul 04 10:15:07.716628 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8ad32bbb-6ba6-4426-b235-4a5edd5ed7bf tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Request method failure captured: Jul 04 10:15:07.716628 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: request: DELETE /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00 HTTP/1.1 Jul 04 10:15:07.716628 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept: application/json Jul 04 10:15:07.716628 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept-Encoding: identity Jul 04 10:15:07.716628 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Connection: close Jul 04 10:15:07.716628 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Length: 0 Jul 04 10:15:07.716628 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Type: application/json Jul 04 10:15:07.716628 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Host: 10.222.0.79 Jul 04 10:15:07.716628 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 04 10:15:07.716628 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 04 10:15:07.716628 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Auth-Token: gAAAAABiwrwvD9yiGE4pStEGBF2Ys-pryu1tx1k2auUnE0PRvpPvnRtEQEaHpqZQ8egutal5ICM4nB9U9UkZUlVAaFmujyok7-zJ_4u8OoD2UCOlqV-Oyun1vIdrrzMPcAwbXsLkKDns-0TZYcaWBDNIYObNG0qh5NpdFBBI5iioapUAgXk4vDM Jul 04 10:15:07.716628 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Id: None Jul 04 10:15:07.716628 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Name: None Jul 04 10:15:07.716628 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 04 10:15:07.716628 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 04 10:15:07.716628 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 04 10:15:07.716628 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 04 10:15:07.716628 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Id: a57f93d66f534107a228d908afa64890 Jul 04 10:15:07.716628 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Name: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:15:07.716628 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Role: reader,member Jul 04 10:15:07.716628 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Roles: reader,member Jul 04 10:15:07.718416 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a57f93d66f534107a228d908afa64890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a57f93d66f534107a228d908afa64890"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a57f93d66f534107a228d908afa64890"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a57f93d66f534107a228d908afa64890"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:15:07.718416 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:15:07.718416 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Id: a57f93d66f534107a228d908afa64890 Jul 04 10:15:07.718416 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:15:07.718416 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User: tempest-AttachVolumeNegativeTest-223944498-project Jul 04 10:15:07.718416 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 04 10:15:07.718416 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 04 10:15:07.718416 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Id: 88d2351fc3b74ef5a530fded1be6b997 Jul 04 10:15:07.718416 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Name: tempest-AttachVolumeNegativeTest-223944498-project Jul 04 10:15:07.718416 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: method: > Jul 04 10:15:07.718416 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: exception: Instance a936822b-ef8c-42ad-9510-194756830a00 could not be found. Jul 04 10:15:07.718416 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: action_args: {'id': 'a936822b-ef8c-42ad-9510-194756830a00'} Jul 04 10:15:07.719564 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:15:07.719564 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:07.719564 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:15:07.719564 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:15:07.719564 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:15:07.719564 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:15:07.719564 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:15:07.719564 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:15:07.719564 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:15:07.719564 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:15:07.719564 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a936822b-ef8c-42ad-9510-194756830a00 could not be found. Jul 04 10:15:07.719564 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:07.719564 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:07.719564 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:07.719564 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:07.719564 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:07.719564 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:07.719564 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:15:07.719564 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:15:07.719564 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:15:07.721272 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:15:07.721272 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 10:15:07.721272 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 10:15:07.721272 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 10:15:07.721272 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 10:15:07.721272 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:15:07.721272 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:15:07.721272 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:15:07.721272 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:15:07.721272 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a936822b-ef8c-42ad-9510-194756830a00 could not be found. Jul 04 10:15:07.721272 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:07.721272 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:07.721272 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:07.721272 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:07.721272 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:07.721272 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:07.721272 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:15:07.721272 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:15:07.721272 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a936822b-ef8c-42ad-9510-194756830a00 could not be found. Jul 04 10:15:07.721272 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:07.722683 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8ad32bbb-6ba6-4426-b235-4a5edd5ed7bf tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Returning 404 to user: Instance a936822b-ef8c-42ad-9510-194756830a00 could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:15:07.722683 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-8ad32bbb-6ba6-4426-b235-4a5edd5ed7bf tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00" status: 404 len: 111 microversion: 2.1 time: 0.031262 Jul 04 10:15:07.722683 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 382/766] 10.222.0.79 () {58 vars in 1238 bytes} [Mon Jul 4 10:15:07 2022] DELETE /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:15:07.727520 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-28445dfe-2a54-44c8-b2bb-38926c21619e tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:07.728208 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-28445dfe-2a54-44c8-b2bb-38926c21619e tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: a936822b-ef8c-42ad-9510-194756830a00] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:07.735491 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-28445dfe-2a54-44c8-b2bb-38926c21619e tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:07.735991 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-28445dfe-2a54-44c8-b2bb-38926c21619e tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:07.736824 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-28445dfe-2a54-44c8-b2bb-38926c21619e tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:07.737249 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-28445dfe-2a54-44c8-b2bb-38926c21619e tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:07.751175 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.wsgi [None req-28445dfe-2a54-44c8-b2bb-38926c21619e tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] HTTP exception thrown: Instance a936822b-ef8c-42ad-9510-194756830a00 could not be found. Jul 04 10:15:07.752710 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-28445dfe-2a54-44c8-b2bb-38926c21619e tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Request method failure captured: Jul 04 10:15:07.752710 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: request: GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00 HTTP/1.1 Jul 04 10:15:07.752710 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept: application/json Jul 04 10:15:07.752710 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept-Encoding: identity Jul 04 10:15:07.752710 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Connection: close Jul 04 10:15:07.752710 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Length: 0 Jul 04 10:15:07.752710 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Type: application/json Jul 04 10:15:07.752710 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Host: 10.222.0.79 Jul 04 10:15:07.752710 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Openstack-System-Scope: None Jul 04 10:15:07.752710 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: User-Agent: python-urllib3/1.26.9 Jul 04 10:15:07.752710 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Auth-Token: gAAAAABiwrwvD9yiGE4pStEGBF2Ys-pryu1tx1k2auUnE0PRvpPvnRtEQEaHpqZQ8egutal5ICM4nB9U9UkZUlVAaFmujyok7-zJ_4u8OoD2UCOlqV-Oyun1vIdrrzMPcAwbXsLkKDns-0TZYcaWBDNIYObNG0qh5NpdFBBI5iioapUAgXk4vDM Jul 04 10:15:07.752710 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Id: None Jul 04 10:15:07.752710 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Name: None Jul 04 10:15:07.752710 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Identity-Status: Confirmed Jul 04 10:15:07.752710 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Is-Admin-Project: True Jul 04 10:15:07.752710 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Id: default Jul 04 10:15:07.752710 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Name: Default Jul 04 10:15:07.752710 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Id: a57f93d66f534107a228d908afa64890 Jul 04 10:15:07.752710 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Name: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:15:07.752710 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Role: reader,member Jul 04 10:15:07.752710 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Roles: reader,member Jul 04 10:15:07.754325 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a57f93d66f534107a228d908afa64890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a57f93d66f534107a228d908afa64890"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a57f93d66f534107a228d908afa64890"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a57f93d66f534107a228d908afa64890"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:15:07.754325 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:15:07.754325 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Id: a57f93d66f534107a228d908afa64890 Jul 04 10:15:07.754325 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:15:07.754325 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User: tempest-AttachVolumeNegativeTest-223944498-project Jul 04 10:15:07.754325 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Id: default Jul 04 10:15:07.754325 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Name: Default Jul 04 10:15:07.754325 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Id: 88d2351fc3b74ef5a530fded1be6b997 Jul 04 10:15:07.754325 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Name: tempest-AttachVolumeNegativeTest-223944498-project Jul 04 10:15:07.754325 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: method: > Jul 04 10:15:07.754325 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: exception: Instance a936822b-ef8c-42ad-9510-194756830a00 could not be found. Jul 04 10:15:07.754325 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: action_args: {'id': 'a936822b-ef8c-42ad-9510-194756830a00'} Jul 04 10:15:07.755513 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:15:07.755513 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:07.755513 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:15:07.755513 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:15:07.755513 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:15:07.755513 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:15:07.755513 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:15:07.755513 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:15:07.755513 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:15:07.755513 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:15:07.755513 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a936822b-ef8c-42ad-9510-194756830a00 could not be found. Jul 04 10:15:07.755513 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:07.755513 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:07.755513 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:07.755513 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:07.755513 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:07.755513 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:07.755513 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:15:07.755513 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:15:07.755513 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:15:07.756954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:15:07.756954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 10:15:07.756954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 10:15:07.756954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:15:07.756954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:15:07.756954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:15:07.756954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:15:07.756954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a936822b-ef8c-42ad-9510-194756830a00 could not be found. Jul 04 10:15:07.756954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:07.756954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:07.756954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:07.756954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:07.756954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:07.756954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:07.756954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:15:07.756954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:15:07.756954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a936822b-ef8c-42ad-9510-194756830a00 could not be found. Jul 04 10:15:07.756954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:07.758357 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-28445dfe-2a54-44c8-b2bb-38926c21619e tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Returning 404 to user: Instance a936822b-ef8c-42ad-9510-194756830a00 could not be found. {{(pid=117866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:15:07.758357 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-28445dfe-2a54-44c8-b2bb-38926c21619e tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00" status: 404 len: 111 microversion: 2.1 time: 0.030833 Jul 04 10:15:07.758357 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 385/767] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:15:07 2022] GET /compute/v2.1/servers/a936822b-ef8c-42ad-9510-194756830a00 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:15:07.762040 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-c8e52321-6a4e-499a-b6b4-f7b75eebbf2a tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:07.762552 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-c8e52321-6a4e-499a-b6b4-f7b75eebbf2a tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 13a952ca-c64f-4b22-89d3-3911935ee74d] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:07.762670 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-7852d95a-15a0-465d-bd82-350a48bdc6af tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d3336bd-c1de-4bdb-87ed-7c2dc8642c69", "device": "/dev/sdb"}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:15:07.764175 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-7852d95a-15a0-465d-bd82-350a48bdc6af tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: 82a2a58e-dfab-406a-a775-4a992d898eac] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:07.768693 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c8e52321-6a4e-499a-b6b4-f7b75eebbf2a tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:07.769136 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c8e52321-6a4e-499a-b6b4-f7b75eebbf2a tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:07.769915 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c8e52321-6a4e-499a-b6b4-f7b75eebbf2a tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:07.770139 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7852d95a-15a0-465d-bd82-350a48bdc6af tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:07.770343 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c8e52321-6a4e-499a-b6b4-f7b75eebbf2a tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:07.770577 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7852d95a-15a0-465d-bd82-350a48bdc6af tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:07.771428 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7852d95a-15a0-465d-bd82-350a48bdc6af tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:07.771952 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7852d95a-15a0-465d-bd82-350a48bdc6af tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:07.784110 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.wsgi [None req-c8e52321-6a4e-499a-b6b4-f7b75eebbf2a tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] HTTP exception thrown: Instance 13a952ca-c64f-4b22-89d3-3911935ee74d could not be found. Jul 04 10:15:07.785640 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-c8e52321-6a4e-499a-b6b4-f7b75eebbf2a tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Request method failure captured: Jul 04 10:15:07.785640 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: request: DELETE /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d HTTP/1.1 Jul 04 10:15:07.785640 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept: application/json Jul 04 10:15:07.785640 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept-Encoding: identity Jul 04 10:15:07.785640 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Connection: close Jul 04 10:15:07.785640 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Length: 0 Jul 04 10:15:07.785640 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Type: application/json Jul 04 10:15:07.785640 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Host: 10.222.0.79 Jul 04 10:15:07.785640 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Openstack-System-Scope: None Jul 04 10:15:07.785640 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: User-Agent: python-urllib3/1.26.9 Jul 04 10:15:07.785640 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Auth-Token: gAAAAABiwrwvD9yiGE4pStEGBF2Ys-pryu1tx1k2auUnE0PRvpPvnRtEQEaHpqZQ8egutal5ICM4nB9U9UkZUlVAaFmujyok7-zJ_4u8OoD2UCOlqV-Oyun1vIdrrzMPcAwbXsLkKDns-0TZYcaWBDNIYObNG0qh5NpdFBBI5iioapUAgXk4vDM Jul 04 10:15:07.785640 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Id: None Jul 04 10:15:07.785640 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Name: None Jul 04 10:15:07.785640 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Identity-Status: Confirmed Jul 04 10:15:07.785640 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Is-Admin-Project: True Jul 04 10:15:07.785640 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Id: default Jul 04 10:15:07.785640 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Name: Default Jul 04 10:15:07.785640 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Id: a57f93d66f534107a228d908afa64890 Jul 04 10:15:07.785640 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Name: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:15:07.785640 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Role: reader,member Jul 04 10:15:07.785640 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Roles: reader,member Jul 04 10:15:07.787152 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a57f93d66f534107a228d908afa64890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a57f93d66f534107a228d908afa64890"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a57f93d66f534107a228d908afa64890"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a57f93d66f534107a228d908afa64890"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:15:07.787152 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:15:07.787152 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Id: a57f93d66f534107a228d908afa64890 Jul 04 10:15:07.787152 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:15:07.787152 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User: tempest-AttachVolumeNegativeTest-223944498-project Jul 04 10:15:07.787152 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Id: default Jul 04 10:15:07.787152 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Name: Default Jul 04 10:15:07.787152 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Id: 88d2351fc3b74ef5a530fded1be6b997 Jul 04 10:15:07.787152 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Name: tempest-AttachVolumeNegativeTest-223944498-project Jul 04 10:15:07.787152 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: method: > Jul 04 10:15:07.787152 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: exception: Instance 13a952ca-c64f-4b22-89d3-3911935ee74d could not be found. Jul 04 10:15:07.787152 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: action_args: {'id': '13a952ca-c64f-4b22-89d3-3911935ee74d'} Jul 04 10:15:07.788415 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:15:07.788415 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:07.788415 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:15:07.788415 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:15:07.788415 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:15:07.788415 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:15:07.788415 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:15:07.788415 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:15:07.788415 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:15:07.788415 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:15:07.788415 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13a952ca-c64f-4b22-89d3-3911935ee74d could not be found. Jul 04 10:15:07.788415 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:07.788415 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:07.788415 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:07.788415 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:07.788415 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:07.788415 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:07.788415 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:15:07.788415 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:15:07.788415 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:15:07.789869 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:15:07.789869 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 10:15:07.789869 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 10:15:07.789869 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 10:15:07.789869 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 10:15:07.789869 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:15:07.789869 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:15:07.789869 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:15:07.789869 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:15:07.789869 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13a952ca-c64f-4b22-89d3-3911935ee74d could not be found. Jul 04 10:15:07.789869 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:07.789869 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:07.789869 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:07.789869 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:07.789869 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:07.789869 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:07.789869 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:15:07.789869 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:15:07.789869 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13a952ca-c64f-4b22-89d3-3911935ee74d could not be found. Jul 04 10:15:07.789869 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:07.791413 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-c8e52321-6a4e-499a-b6b4-f7b75eebbf2a tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Returning 404 to user: Instance 13a952ca-c64f-4b22-89d3-3911935ee74d could not be found. {{(pid=117866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:15:07.791413 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-c8e52321-6a4e-499a-b6b4-f7b75eebbf2a tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "DELETE /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d" status: 404 len: 111 microversion: 2.1 time: 0.028568 Jul 04 10:15:07.791413 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 386/768] 10.222.0.79 () {58 vars in 1238 bytes} [Mon Jul 4 10:15:07 2022] DELETE /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:15:07.795229 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-cb286d38-61a0-4339-825a-5171efc21e30 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:07.795831 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-cb286d38-61a0-4339-825a-5171efc21e30 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 13a952ca-c64f-4b22-89d3-3911935ee74d] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:07.801633 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-cb286d38-61a0-4339-825a-5171efc21e30 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:07.802095 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-cb286d38-61a0-4339-825a-5171efc21e30 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:07.803119 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-cb286d38-61a0-4339-825a-5171efc21e30 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:07.803551 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-cb286d38-61a0-4339-825a-5171efc21e30 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:07.817281 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.wsgi [None req-cb286d38-61a0-4339-825a-5171efc21e30 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] HTTP exception thrown: Instance 13a952ca-c64f-4b22-89d3-3911935ee74d could not be found. Jul 04 10:15:07.819154 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-cb286d38-61a0-4339-825a-5171efc21e30 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Request method failure captured: Jul 04 10:15:07.819154 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: request: GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d HTTP/1.1 Jul 04 10:15:07.819154 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept: application/json Jul 04 10:15:07.819154 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept-Encoding: identity Jul 04 10:15:07.819154 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Connection: close Jul 04 10:15:07.819154 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Length: 0 Jul 04 10:15:07.819154 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Type: application/json Jul 04 10:15:07.819154 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Host: 10.222.0.79 Jul 04 10:15:07.819154 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Openstack-System-Scope: None Jul 04 10:15:07.819154 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: User-Agent: python-urllib3/1.26.9 Jul 04 10:15:07.819154 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Auth-Token: gAAAAABiwrwvD9yiGE4pStEGBF2Ys-pryu1tx1k2auUnE0PRvpPvnRtEQEaHpqZQ8egutal5ICM4nB9U9UkZUlVAaFmujyok7-zJ_4u8OoD2UCOlqV-Oyun1vIdrrzMPcAwbXsLkKDns-0TZYcaWBDNIYObNG0qh5NpdFBBI5iioapUAgXk4vDM Jul 04 10:15:07.819154 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Id: None Jul 04 10:15:07.819154 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Name: None Jul 04 10:15:07.819154 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Identity-Status: Confirmed Jul 04 10:15:07.819154 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Is-Admin-Project: True Jul 04 10:15:07.819154 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Id: default Jul 04 10:15:07.819154 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Name: Default Jul 04 10:15:07.819154 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Id: a57f93d66f534107a228d908afa64890 Jul 04 10:15:07.819154 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Name: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:15:07.819154 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Role: reader,member Jul 04 10:15:07.819154 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Roles: reader,member Jul 04 10:15:07.820732 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a57f93d66f534107a228d908afa64890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a57f93d66f534107a228d908afa64890"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a57f93d66f534107a228d908afa64890"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a57f93d66f534107a228d908afa64890"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:15:07.820732 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:15:07.820732 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Id: a57f93d66f534107a228d908afa64890 Jul 04 10:15:07.820732 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:15:07.820732 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User: tempest-AttachVolumeNegativeTest-223944498-project Jul 04 10:15:07.820732 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Id: default Jul 04 10:15:07.820732 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Name: Default Jul 04 10:15:07.820732 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Id: 88d2351fc3b74ef5a530fded1be6b997 Jul 04 10:15:07.820732 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Name: tempest-AttachVolumeNegativeTest-223944498-project Jul 04 10:15:07.820732 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: method: > Jul 04 10:15:07.820732 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: exception: Instance 13a952ca-c64f-4b22-89d3-3911935ee74d could not be found. Jul 04 10:15:07.820732 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: action_args: {'id': '13a952ca-c64f-4b22-89d3-3911935ee74d'} Jul 04 10:15:07.821859 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:15:07.821859 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:07.821859 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:15:07.821859 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:15:07.821859 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:15:07.821859 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:15:07.821859 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:15:07.821859 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:15:07.821859 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:15:07.821859 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:15:07.821859 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13a952ca-c64f-4b22-89d3-3911935ee74d could not be found. Jul 04 10:15:07.821859 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:07.821859 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:07.821859 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:07.821859 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:07.821859 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:07.821859 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:07.821859 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:15:07.821859 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:15:07.821859 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:15:07.823503 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:15:07.823503 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 10:15:07.823503 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 10:15:07.823503 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:15:07.823503 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:15:07.823503 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:15:07.823503 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:15:07.823503 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13a952ca-c64f-4b22-89d3-3911935ee74d could not be found. Jul 04 10:15:07.823503 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:07.823503 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:07.823503 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:07.823503 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:07.823503 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:07.823503 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:07.823503 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:15:07.823503 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:15:07.823503 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13a952ca-c64f-4b22-89d3-3911935ee74d could not be found. Jul 04 10:15:07.823503 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:07.825161 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-cb286d38-61a0-4339-825a-5171efc21e30 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Returning 404 to user: Instance 13a952ca-c64f-4b22-89d3-3911935ee74d could not be found. {{(pid=117866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:15:07.825161 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-cb286d38-61a0-4339-825a-5171efc21e30 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d" status: 404 len: 111 microversion: 2.1 time: 0.028909 Jul 04 10:15:07.825161 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 387/769] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:15:07 2022] GET /compute/v2.1/servers/13a952ca-c64f-4b22-89d3-3911935ee74d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:15:08.035958 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-7852d95a-15a0-465d-bd82-350a48bdc6af tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "POST /compute/v2.1/servers/82a2a58e-dfab-406a-a775-4a992d898eac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277200 Jul 04 10:15:08.036627 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 383/770] 10.222.0.79 () {60 vars in 1322 bytes} [Mon Jul 4 10:15:07 2022] POST /compute/v2.1/servers/82a2a58e-dfab-406a-a775-4a992d898eac/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:15:08.062162 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-32620e48-b8f6-4b6a-9acd-7c10f462d69e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:08.062928 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-32620e48-b8f6-4b6a-9acd-7c10f462d69e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:08.069476 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-32620e48-b8f6-4b6a-9acd-7c10f462d69e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:08.069977 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-32620e48-b8f6-4b6a-9acd-7c10f462d69e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:08.070756 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-32620e48-b8f6-4b6a-9acd-7c10f462d69e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:08.071218 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-32620e48-b8f6-4b6a-9acd-7c10f462d69e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:08.087579 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.wsgi [None req-32620e48-b8f6-4b6a-9acd-7c10f462d69e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] HTTP exception thrown: Instance a842f878-2275-4988-8e51-b3b7276678e7 could not be found. Jul 04 10:15:08.089514 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-32620e48-b8f6-4b6a-9acd-7c10f462d69e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Request method failure captured: Jul 04 10:15:08.089514 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: request: DELETE /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 HTTP/1.1 Jul 04 10:15:08.089514 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept: application/json Jul 04 10:15:08.089514 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept-Encoding: identity Jul 04 10:15:08.089514 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Connection: close Jul 04 10:15:08.089514 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Length: 0 Jul 04 10:15:08.089514 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Type: application/json Jul 04 10:15:08.089514 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Host: 10.222.0.79 Jul 04 10:15:08.089514 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Openstack-System-Scope: None Jul 04 10:15:08.089514 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: User-Agent: python-urllib3/1.26.9 Jul 04 10:15:08.089514 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Auth-Token: gAAAAABiwrwqqpSzXCz6TI7i3v3Q0Ikv6eP5G-aFeEx1FMOX4uF8_xFSEGq1OvsjmphPPgrV_LZ7ApTiSGpB_p8ebTXPQypjNBbmCiLNfN6Vw7ly4_fGoJrpUrTq3Bgn-HxcRgFMGj02UI8_qzoahUfhl7siMEcN-dAFCb5QyOQ3C5VA-l3wHp4 Jul 04 10:15:08.089514 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Id: None Jul 04 10:15:08.089514 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Name: None Jul 04 10:15:08.089514 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Identity-Status: Confirmed Jul 04 10:15:08.089514 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Is-Admin-Project: True Jul 04 10:15:08.089514 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Id: default Jul 04 10:15:08.089514 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Name: Default Jul 04 10:15:08.089514 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Id: 2f559cbed35f4fbb8fe71906696733e7 Jul 04 10:15:08.089514 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Name: tempest-AttachVolumeTestJSON-439716941 Jul 04 10:15:08.089514 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Role: reader,member Jul 04 10:15:08.089514 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Roles: reader,member Jul 04 10:15:08.091045 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2f559cbed35f4fbb8fe71906696733e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2f559cbed35f4fbb8fe71906696733e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2f559cbed35f4fbb8fe71906696733e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2f559cbed35f4fbb8fe71906696733e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:15:08.091045 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant: tempest-AttachVolumeTestJSON-439716941 Jul 04 10:15:08.091045 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Id: 2f559cbed35f4fbb8fe71906696733e7 Jul 04 10:15:08.091045 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Name: tempest-AttachVolumeTestJSON-439716941 Jul 04 10:15:08.091045 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User: tempest-AttachVolumeTestJSON-439716941-project Jul 04 10:15:08.091045 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Id: default Jul 04 10:15:08.091045 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Name: Default Jul 04 10:15:08.091045 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Id: dfba262d439a4253bf1c2c0f114d0cdc Jul 04 10:15:08.091045 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Name: tempest-AttachVolumeTestJSON-439716941-project Jul 04 10:15:08.091045 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: method: > Jul 04 10:15:08.091045 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: exception: Instance a842f878-2275-4988-8e51-b3b7276678e7 could not be found. Jul 04 10:15:08.091045 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: action_args: {'id': 'a842f878-2275-4988-8e51-b3b7276678e7'} Jul 04 10:15:08.091914 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:15:08.091914 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:08.091914 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:15:08.091914 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:15:08.091914 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:15:08.091914 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:15:08.091914 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:15:08.091914 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:15:08.091914 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:15:08.091914 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:15:08.091914 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a842f878-2275-4988-8e51-b3b7276678e7 could not be found. Jul 04 10:15:08.091914 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:08.091914 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:08.091914 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:08.091914 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:08.091914 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:08.091914 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:08.091914 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:15:08.091914 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:15:08.091914 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:15:08.093402 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:15:08.093402 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 10:15:08.093402 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 10:15:08.093402 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 10:15:08.093402 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 10:15:08.093402 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:15:08.093402 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:15:08.093402 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:15:08.093402 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:15:08.093402 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a842f878-2275-4988-8e51-b3b7276678e7 could not be found. Jul 04 10:15:08.093402 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:08.093402 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:08.093402 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:08.093402 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:08.093402 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:08.093402 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:08.093402 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:15:08.093402 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:15:08.093402 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a842f878-2275-4988-8e51-b3b7276678e7 could not be found. Jul 04 10:15:08.093402 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:08.104501 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-32620e48-b8f6-4b6a-9acd-7c10f462d69e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Returning 404 to user: Instance a842f878-2275-4988-8e51-b3b7276678e7 could not be found. {{(pid=117866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:15:08.105426 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-32620e48-b8f6-4b6a-9acd-7c10f462d69e tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 404 len: 111 microversion: 2.1 time: 0.047106 Jul 04 10:15:08.106173 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 388/771] 10.222.0.79 () {58 vars in 1238 bytes} [Mon Jul 4 10:15:08 2022] DELETE /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:15:08.115652 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-291ccfdf-41d7-43a7-a55b-2deb0cd002a0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:08.116332 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-291ccfdf-41d7-43a7-a55b-2deb0cd002a0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] [instance: a842f878-2275-4988-8e51-b3b7276678e7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:08.128352 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-291ccfdf-41d7-43a7-a55b-2deb0cd002a0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:08.128839 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-291ccfdf-41d7-43a7-a55b-2deb0cd002a0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:08.129759 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-291ccfdf-41d7-43a7-a55b-2deb0cd002a0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:08.130076 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-291ccfdf-41d7-43a7-a55b-2deb0cd002a0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:08.145241 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-291ccfdf-41d7-43a7-a55b-2deb0cd002a0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] HTTP exception thrown: Instance a842f878-2275-4988-8e51-b3b7276678e7 could not be found. Jul 04 10:15:08.146954 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-291ccfdf-41d7-43a7-a55b-2deb0cd002a0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Request method failure captured: Jul 04 10:15:08.146954 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: request: GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 HTTP/1.1 Jul 04 10:15:08.146954 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept: application/json Jul 04 10:15:08.146954 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept-Encoding: identity Jul 04 10:15:08.146954 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Connection: close Jul 04 10:15:08.146954 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Length: 0 Jul 04 10:15:08.146954 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Type: application/json Jul 04 10:15:08.146954 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Host: 10.222.0.79 Jul 04 10:15:08.146954 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 04 10:15:08.146954 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 04 10:15:08.146954 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Auth-Token: gAAAAABiwrwqqpSzXCz6TI7i3v3Q0Ikv6eP5G-aFeEx1FMOX4uF8_xFSEGq1OvsjmphPPgrV_LZ7ApTiSGpB_p8ebTXPQypjNBbmCiLNfN6Vw7ly4_fGoJrpUrTq3Bgn-HxcRgFMGj02UI8_qzoahUfhl7siMEcN-dAFCb5QyOQ3C5VA-l3wHp4 Jul 04 10:15:08.146954 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Id: None Jul 04 10:15:08.146954 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Name: None Jul 04 10:15:08.146954 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 04 10:15:08.146954 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 04 10:15:08.146954 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 04 10:15:08.146954 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 04 10:15:08.146954 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Id: 2f559cbed35f4fbb8fe71906696733e7 Jul 04 10:15:08.146954 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Name: tempest-AttachVolumeTestJSON-439716941 Jul 04 10:15:08.146954 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Role: reader,member Jul 04 10:15:08.146954 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Roles: reader,member Jul 04 10:15:08.148547 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2f559cbed35f4fbb8fe71906696733e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2f559cbed35f4fbb8fe71906696733e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2f559cbed35f4fbb8fe71906696733e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2f559cbed35f4fbb8fe71906696733e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:15:08.148547 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant: tempest-AttachVolumeTestJSON-439716941 Jul 04 10:15:08.148547 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Id: 2f559cbed35f4fbb8fe71906696733e7 Jul 04 10:15:08.148547 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Name: tempest-AttachVolumeTestJSON-439716941 Jul 04 10:15:08.148547 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User: tempest-AttachVolumeTestJSON-439716941-project Jul 04 10:15:08.148547 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 04 10:15:08.148547 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 04 10:15:08.148547 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Id: dfba262d439a4253bf1c2c0f114d0cdc Jul 04 10:15:08.148547 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Name: tempest-AttachVolumeTestJSON-439716941-project Jul 04 10:15:08.148547 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: method: > Jul 04 10:15:08.148547 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: exception: Instance a842f878-2275-4988-8e51-b3b7276678e7 could not be found. Jul 04 10:15:08.148547 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: action_args: {'id': 'a842f878-2275-4988-8e51-b3b7276678e7'} Jul 04 10:15:08.149348 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:15:08.149348 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:08.149348 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:15:08.149348 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:15:08.149348 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:15:08.149348 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:15:08.149348 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:15:08.149348 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:15:08.149348 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:15:08.149348 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:15:08.149348 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a842f878-2275-4988-8e51-b3b7276678e7 could not be found. Jul 04 10:15:08.149348 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:08.149348 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:08.149348 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:08.149348 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:08.149348 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:08.149348 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:08.149348 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:15:08.149348 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:15:08.149348 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:15:08.150758 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:15:08.150758 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 10:15:08.150758 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 10:15:08.150758 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:15:08.150758 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:15:08.150758 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:15:08.150758 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:15:08.150758 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a842f878-2275-4988-8e51-b3b7276678e7 could not be found. Jul 04 10:15:08.150758 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:08.150758 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:08.150758 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:08.150758 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:08.150758 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:08.150758 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:08.150758 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:15:08.150758 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:15:08.150758 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a842f878-2275-4988-8e51-b3b7276678e7 could not be found. Jul 04 10:15:08.150758 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:08.152021 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-291ccfdf-41d7-43a7-a55b-2deb0cd002a0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] Returning 404 to user: Instance a842f878-2275-4988-8e51-b3b7276678e7 could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:15:08.152021 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-291ccfdf-41d7-43a7-a55b-2deb0cd002a0 tempest-AttachVolumeTestJSON-439716941 tempest-AttachVolumeTestJSON-439716941-project] 10.222.0.79 "GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7" status: 404 len: 111 microversion: 2.1 time: 0.037586 Jul 04 10:15:08.152021 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 384/772] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:15:08 2022] GET /compute/v2.1/servers/a842f878-2275-4988-8e51-b3b7276678e7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:15:08.966315 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-8e1dca4a-bf8e-4338-aad4-625e5e83ab51 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:08.967429 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-8e1dca4a-bf8e-4338-aad4-625e5e83ab51 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:08.973946 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8e1dca4a-bf8e-4338-aad4-625e5e83ab51 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:08.974873 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8e1dca4a-bf8e-4338-aad4-625e5e83ab51 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:08.976107 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8e1dca4a-bf8e-4338-aad4-625e5e83ab51 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:08.976548 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8e1dca4a-bf8e-4338-aad4-625e5e83ab51 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:08.990407 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.wsgi [None req-8e1dca4a-bf8e-4338-aad4-625e5e83ab51 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] HTTP exception thrown: Instance 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d could not be found. Jul 04 10:15:08.992460 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-8e1dca4a-bf8e-4338-aad4-625e5e83ab51 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Request method failure captured: Jul 04 10:15:08.992460 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: request: DELETE /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d HTTP/1.1 Jul 04 10:15:08.992460 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept: application/json Jul 04 10:15:08.992460 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept-Encoding: identity Jul 04 10:15:08.992460 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Connection: close Jul 04 10:15:08.992460 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Length: 0 Jul 04 10:15:08.992460 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Type: application/json Jul 04 10:15:08.992460 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Host: 10.222.0.79 Jul 04 10:15:08.992460 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Openstack-System-Scope: None Jul 04 10:15:08.992460 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: User-Agent: python-urllib3/1.26.9 Jul 04 10:15:08.992460 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Auth-Token: gAAAAABiwrwvD9yiGE4pStEGBF2Ys-pryu1tx1k2auUnE0PRvpPvnRtEQEaHpqZQ8egutal5ICM4nB9U9UkZUlVAaFmujyok7-zJ_4u8OoD2UCOlqV-Oyun1vIdrrzMPcAwbXsLkKDns-0TZYcaWBDNIYObNG0qh5NpdFBBI5iioapUAgXk4vDM Jul 04 10:15:08.992460 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Id: None Jul 04 10:15:08.992460 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Name: None Jul 04 10:15:08.992460 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Identity-Status: Confirmed Jul 04 10:15:08.992460 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Is-Admin-Project: True Jul 04 10:15:08.992460 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Id: default Jul 04 10:15:08.992460 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Name: Default Jul 04 10:15:08.992460 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Id: a57f93d66f534107a228d908afa64890 Jul 04 10:15:08.992460 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Name: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:15:08.992460 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Role: reader,member Jul 04 10:15:08.992460 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Roles: reader,member Jul 04 10:15:08.994084 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a57f93d66f534107a228d908afa64890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a57f93d66f534107a228d908afa64890"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a57f93d66f534107a228d908afa64890"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a57f93d66f534107a228d908afa64890"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:15:08.994084 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:15:08.994084 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Id: a57f93d66f534107a228d908afa64890 Jul 04 10:15:08.994084 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:15:08.994084 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User: tempest-AttachVolumeNegativeTest-223944498-project Jul 04 10:15:08.994084 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Id: default Jul 04 10:15:08.994084 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Name: Default Jul 04 10:15:08.994084 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Id: 88d2351fc3b74ef5a530fded1be6b997 Jul 04 10:15:08.994084 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Name: tempest-AttachVolumeNegativeTest-223944498-project Jul 04 10:15:08.994084 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: method: > Jul 04 10:15:08.994084 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: exception: Instance 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d could not be found. Jul 04 10:15:08.994084 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: action_args: {'id': '9659bd27-cdfe-44b1-9ffe-bec5319c9b5d'} Jul 04 10:15:08.995222 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:15:08.995222 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:08.995222 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:15:08.995222 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:15:08.995222 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:15:08.995222 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:15:08.995222 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:15:08.995222 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:15:08.995222 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:15:08.995222 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:15:08.995222 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d could not be found. Jul 04 10:15:08.995222 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:08.995222 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:08.995222 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:08.995222 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:08.995222 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:08.995222 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:08.995222 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:15:08.995222 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:15:08.995222 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:15:08.996453 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:15:08.996453 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 10:15:08.996453 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 10:15:08.996453 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 10:15:08.996453 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 10:15:08.996453 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:15:08.996453 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:15:08.996453 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:15:08.996453 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:15:08.996453 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d could not be found. Jul 04 10:15:08.996453 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:08.996453 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:08.996453 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:08.996453 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:08.996453 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:08.996453 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:08.996453 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:15:08.996453 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:15:08.996453 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d could not be found. Jul 04 10:15:08.996453 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:08.998430 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-8e1dca4a-bf8e-4338-aad4-625e5e83ab51 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Returning 404 to user: Instance 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d could not be found. {{(pid=117866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:15:08.998430 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-8e1dca4a-bf8e-4338-aad4-625e5e83ab51 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d" status: 404 len: 111 microversion: 2.1 time: 0.031732 Jul 04 10:15:08.998430 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 389/773] 10.222.0.79 () {58 vars in 1238 bytes} [Mon Jul 4 10:15:08 2022] DELETE /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:15:09.003168 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-0f8c7626-552b-4f49-8d5f-1f69ab699201 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:09.003781 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-0f8c7626-552b-4f49-8d5f-1f69ab699201 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] [instance: 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:09.011149 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0f8c7626-552b-4f49-8d5f-1f69ab699201 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:09.011587 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0f8c7626-552b-4f49-8d5f-1f69ab699201 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:09.012384 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0f8c7626-552b-4f49-8d5f-1f69ab699201 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:09.012823 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0f8c7626-552b-4f49-8d5f-1f69ab699201 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:09.027089 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-0f8c7626-552b-4f49-8d5f-1f69ab699201 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] HTTP exception thrown: Instance 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d could not be found. Jul 04 10:15:09.028610 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-0f8c7626-552b-4f49-8d5f-1f69ab699201 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Request method failure captured: Jul 04 10:15:09.028610 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: request: GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d HTTP/1.1 Jul 04 10:15:09.028610 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept: application/json Jul 04 10:15:09.028610 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept-Encoding: identity Jul 04 10:15:09.028610 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Connection: close Jul 04 10:15:09.028610 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Length: 0 Jul 04 10:15:09.028610 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Type: application/json Jul 04 10:15:09.028610 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Host: 10.222.0.79 Jul 04 10:15:09.028610 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 04 10:15:09.028610 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 04 10:15:09.028610 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Auth-Token: gAAAAABiwrwvD9yiGE4pStEGBF2Ys-pryu1tx1k2auUnE0PRvpPvnRtEQEaHpqZQ8egutal5ICM4nB9U9UkZUlVAaFmujyok7-zJ_4u8OoD2UCOlqV-Oyun1vIdrrzMPcAwbXsLkKDns-0TZYcaWBDNIYObNG0qh5NpdFBBI5iioapUAgXk4vDM Jul 04 10:15:09.028610 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Id: None Jul 04 10:15:09.028610 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Name: None Jul 04 10:15:09.028610 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 04 10:15:09.028610 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 04 10:15:09.028610 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 04 10:15:09.028610 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 04 10:15:09.028610 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Id: a57f93d66f534107a228d908afa64890 Jul 04 10:15:09.028610 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Name: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:15:09.028610 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Role: reader,member Jul 04 10:15:09.028610 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Roles: reader,member Jul 04 10:15:09.029947 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a57f93d66f534107a228d908afa64890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a57f93d66f534107a228d908afa64890"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a57f93d66f534107a228d908afa64890"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a57f93d66f534107a228d908afa64890"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:15:09.029947 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:15:09.029947 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Id: a57f93d66f534107a228d908afa64890 Jul 04 10:15:09.029947 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-223944498 Jul 04 10:15:09.029947 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User: tempest-AttachVolumeNegativeTest-223944498-project Jul 04 10:15:09.029947 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 04 10:15:09.029947 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 04 10:15:09.029947 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Id: 88d2351fc3b74ef5a530fded1be6b997 Jul 04 10:15:09.029947 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Name: tempest-AttachVolumeNegativeTest-223944498-project Jul 04 10:15:09.029947 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: method: > Jul 04 10:15:09.029947 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: exception: Instance 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d could not be found. Jul 04 10:15:09.029947 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: action_args: {'id': '9659bd27-cdfe-44b1-9ffe-bec5319c9b5d'} Jul 04 10:15:09.030678 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:15:09.030678 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:09.030678 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:15:09.030678 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:15:09.030678 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:15:09.030678 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:15:09.030678 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:15:09.030678 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:15:09.030678 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:15:09.030678 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:15:09.030678 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d could not be found. Jul 04 10:15:09.030678 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:09.030678 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:09.030678 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:09.030678 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:09.030678 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:09.030678 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:09.030678 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:15:09.030678 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:15:09.030678 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:15:09.031820 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:15:09.031820 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 10:15:09.031820 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 10:15:09.031820 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:15:09.031820 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:15:09.031820 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:15:09.031820 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:15:09.031820 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d could not be found. Jul 04 10:15:09.031820 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:09.031820 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:09.031820 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:09.031820 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:09.031820 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:09.031820 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:09.031820 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:15:09.031820 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:15:09.031820 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d could not be found. Jul 04 10:15:09.031820 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:09.033148 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-0f8c7626-552b-4f49-8d5f-1f69ab699201 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] Returning 404 to user: Instance 9659bd27-cdfe-44b1-9ffe-bec5319c9b5d could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:15:09.033148 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-0f8c7626-552b-4f49-8d5f-1f69ab699201 tempest-AttachVolumeNegativeTest-223944498 tempest-AttachVolumeNegativeTest-223944498-project] 10.222.0.79 "GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d" status: 404 len: 111 microversion: 2.1 time: 0.030764 Jul 04 10:15:09.033148 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 385/774] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:15:08 2022] GET /compute/v2.1/servers/9659bd27-cdfe-44b1-9ffe-bec5319c9b5d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:15:15.517837 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-2e82f4b1-521c-40f6-a41b-8635921b7f4d tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] Action: 'create', calling method: .version_select at 0x7f2802fd9b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1953203143"}} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:15:15.834464 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-2e82f4b1-521c-40f6-a41b-8635921b7f4d tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.430540 Jul 04 10:15:15.835244 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 390/775] 10.222.0.79 () {60 vars in 1154 bytes} [Mon Jul 4 10:15:15 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 432 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 04 10:15:15.847124 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-57c53112-1b17-468e-a6cb-07d50018af1a tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] Calling method '.version_select at 0x7f2802e90af0>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:15.901009 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-57c53112-1b17-468e-a6cb-07d50018af1a tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/e02274ca-bfd5-4d77-86b8-539db2fbcfb3" status: 200 len: 345 microversion: 2.1 time: 0.058027 Jul 04 10:15:15.901944 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 386/776] 10.222.0.79 () {58 vars in 1244 bytes} [Mon Jul 4 10:15:15 2022] GET /compute/v2.1/os-volumes/e02274ca-bfd5-4d77-86b8-539db2fbcfb3 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:15:16.918492 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-04661e21-fcfb-42ea-9443-4a05d598ab45 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] Calling method '.version_select at 0x7f2802fda670>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:16.966321 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-04661e21-fcfb-42ea-9443-4a05d598ab45 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/e02274ca-bfd5-4d77-86b8-539db2fbcfb3" status: 200 len: 345 microversion: 2.1 time: 0.054659 Jul 04 10:15:16.966889 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 391/777] 10.222.0.79 () {58 vars in 1244 bytes} [Mon Jul 4 10:15:16 2022] GET /compute/v2.1/os-volumes/e02274ca-bfd5-4d77-86b8-539db2fbcfb3 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:15:17.981508 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2e0e5c2f-ed8f-4a36-b840-c0a42787ccc8 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] Calling method '.version_select at 0x7f2802e3f1f0>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:18.030147 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-2e0e5c2f-ed8f-4a36-b840-c0a42787ccc8 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/e02274ca-bfd5-4d77-86b8-539db2fbcfb3" status: 200 len: 345 microversion: 2.1 time: 0.053443 Jul 04 10:15:18.030715 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 387/778] 10.222.0.79 () {58 vars in 1244 bytes} [Mon Jul 4 10:15:17 2022] GET /compute/v2.1/os-volumes/e02274ca-bfd5-4d77-86b8-539db2fbcfb3 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:15:18.071993 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-e8a371a2-2f70-468e-ae7e-4467b8acba6b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:18.072839 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-e8a371a2-2f70-468e-ae7e-4467b8acba6b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:18.075827 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:15:18.081391 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e8a371a2-2f70-468e-ae7e-4467b8acba6b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:18.081876 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e8a371a2-2f70-468e-ae7e-4467b8acba6b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:18.082647 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e8a371a2-2f70-468e-ae7e-4467b8acba6b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:18.083132 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e8a371a2-2f70-468e-ae7e-4467b8acba6b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:18.114665 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-e8a371a2-2f70-468e-ae7e-4467b8acba6b tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047953 Jul 04 10:15:18.115227 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 392/779] 10.222.0.79 () {60 vars in 1342 bytes} [Mon Jul 4 10:15:18 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:15:18.180759 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-d5ca9efb-7cf9-4b07-acf3-0ea52e877768 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:18.181243 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d5ca9efb-7cf9-4b07-acf3-0ea52e877768 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:18.183325 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:15:18.189929 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d5ca9efb-7cf9-4b07-acf3-0ea52e877768 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:18.190367 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d5ca9efb-7cf9-4b07-acf3-0ea52e877768 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:18.191119 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d5ca9efb-7cf9-4b07-acf3-0ea52e877768 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:18.191541 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d5ca9efb-7cf9-4b07-acf3-0ea52e877768 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:18.218048 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d5ca9efb-7cf9-4b07-acf3-0ea52e877768 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Going to try to terminate instance {{(pid=117865) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 10:15:18.251434 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:15:18.299336 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-d5ca9efb-7cf9-4b07-acf3-0ea52e877768 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 204 len: 0 microversion: 2.20 time: 0.122234 Jul 04 10:15:18.300173 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 388/780] 10.222.0.79 () {60 vars in 1279 bytes} [Mon Jul 4 10:15:18 2022] DELETE /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 04 10:15:18.311152 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-22a8be4a-4ac6-4d1b-b918-f40c99bd5d1f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:18.311784 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-22a8be4a-4ac6-4d1b-b918-f40c99bd5d1f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:18.318744 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-22a8be4a-4ac6-4d1b-b918-f40c99bd5d1f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:18.319228 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-22a8be4a-4ac6-4d1b-b918-f40c99bd5d1f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:18.320204 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-22a8be4a-4ac6-4d1b-b918-f40c99bd5d1f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:18.320640 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-22a8be4a-4ac6-4d1b-b918-f40c99bd5d1f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:18.324605 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:15:18.460853 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-22a8be4a-4ac6-4d1b-b918-f40c99bd5d1f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:18.469637 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-22a8be4a-4ac6-4d1b-b918-f40c99bd5d1f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:18.471135 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-22a8be4a-4ac6-4d1b-b918-f40c99bd5d1f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:18.472296 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-22a8be4a-4ac6-4d1b-b918-f40c99bd5d1f tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1721 microversion: 2.20 time: 0.167001 Jul 04 10:15:18.472858 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 393/781] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:15:18 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:15:19.044114 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-dcc3b87d-fed5-44f6-9bc9-b7544501a890 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] Calling method '.version_select at 0x7f2802f588b0>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:19.174625 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-dcc3b87d-fed5-44f6-9bc9-b7544501a890 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/e02274ca-bfd5-4d77-86b8-539db2fbcfb3" status: 200 len: 346 microversion: 2.1 time: 0.134595 Jul 04 10:15:19.175419 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 389/782] 10.222.0.79 () {58 vars in 1244 bytes} [Mon Jul 4 10:15:19 2022] GET /compute/v2.1/os-volumes/e02274ca-bfd5-4d77-86b8-539db2fbcfb3 => generated 346 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:15:19.187391 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-85fbbf3a-197a-4bea-a42c-43e42e76f161 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] Action: 'create', calling method: .version_select at 0x7f2802f34310>, body: {"snapshot": {"volume_id": "e02274ca-bfd5-4d77-86b8-539db2fbcfb3", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1652550322"}} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:15:19.365136 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-85fbbf3a-197a-4bea-a42c-43e42e76f161 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] 10.222.0.79 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.181803 Jul 04 10:15:19.365752 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 394/783] 10.222.0.79 () {60 vars in 1161 bytes} [Mon Jul 4 10:15:19 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:15:19.376305 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-6d80125f-d8b3-404c-aca1-0437821ca3b0 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] Calling method '.version_select at 0x7f2802f35d30>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:19.407713 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-6d80125f-d8b3-404c-aca1-0437821ca3b0 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/6b4f4074-2f71-4727-b6da-5e116edfd572" status: 200 len: 287 microversion: 2.1 time: 0.035263 Jul 04 10:15:19.408315 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 390/784] 10.222.0.79 () {58 vars in 1250 bytes} [Mon Jul 4 10:15:19 2022] GET /compute/v2.1/os-snapshots/6b4f4074-2f71-4727-b6da-5e116edfd572 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:15:19.418572 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-c69c5aa1-17c8-402f-b895-fcee686ec6c2 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] Calling method '.version_select at 0x7f2802fc1ee0>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:19.448995 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-c69c5aa1-17c8-402f-b895-fcee686ec6c2 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034520 Jul 04 10:15:19.449604 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 395/785] 10.222.0.79 () {58 vars in 1139 bytes} [Mon Jul 4 10:15:19 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:15:19.462292 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-c07dbdba-25f5-47a1-8866-b0870d6a68e1 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] Calling method '.version_select at 0x7f2802ef8b80>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:19.489869 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-fc3b7355-a73f-41bb-912a-2f8234930dad tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:19.490461 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-fc3b7355-a73f-41bb-912a-2f8234930dad tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:19.497164 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-fc3b7355-a73f-41bb-912a-2f8234930dad tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:19.497608 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-fc3b7355-a73f-41bb-912a-2f8234930dad tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:19.498035 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-c07dbdba-25f5-47a1-8866-b0870d6a68e1 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/6b4f4074-2f71-4727-b6da-5e116edfd572" status: 200 len: 287 microversion: 2.1 time: 0.039667 Jul 04 10:15:19.498396 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-fc3b7355-a73f-41bb-912a-2f8234930dad tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:19.498843 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-fc3b7355-a73f-41bb-912a-2f8234930dad tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:19.498953 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 391/786] 10.222.0.79 () {58 vars in 1250 bytes} [Mon Jul 4 10:15:19 2022] GET /compute/v2.1/os-snapshots/6b4f4074-2f71-4727-b6da-5e116edfd572 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:15:19.630379 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-fc3b7355-a73f-41bb-912a-2f8234930dad tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:19.638855 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-fc3b7355-a73f-41bb-912a-2f8234930dad tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:19.640325 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-fc3b7355-a73f-41bb-912a-2f8234930dad tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:19.641466 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-fc3b7355-a73f-41bb-912a-2f8234930dad tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1721 microversion: 2.20 time: 0.155470 Jul 04 10:15:19.642062 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 396/787] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:15:19 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:15:20.515926 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-cb453781-2f7a-4ca3-8615-7fb544bf5b94 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] Calling method '.version_select at 0x7f2802e90af0>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:20.552863 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-cb453781-2f7a-4ca3-8615-7fb544bf5b94 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/6b4f4074-2f71-4727-b6da-5e116edfd572" status: 200 len: 287 microversion: 2.1 time: 0.044394 Jul 04 10:15:20.553423 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 392/788] 10.222.0.79 () {58 vars in 1250 bytes} [Mon Jul 4 10:15:20 2022] GET /compute/v2.1/os-snapshots/6b4f4074-2f71-4727-b6da-5e116edfd572 => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:15:20.664462 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-fee6fd31-2a24-4a96-abeb-86d77dcfe78d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:20.665182 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-fee6fd31-2a24-4a96-abeb-86d77dcfe78d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:20.673156 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-fee6fd31-2a24-4a96-abeb-86d77dcfe78d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:20.673679 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-fee6fd31-2a24-4a96-abeb-86d77dcfe78d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:20.674617 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-fee6fd31-2a24-4a96-abeb-86d77dcfe78d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:20.675127 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-fee6fd31-2a24-4a96-abeb-86d77dcfe78d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:20.811066 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-fee6fd31-2a24-4a96-abeb-86d77dcfe78d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:20.819166 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-fee6fd31-2a24-4a96-abeb-86d77dcfe78d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:20.821081 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-fee6fd31-2a24-4a96-abeb-86d77dcfe78d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:20.822274 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-fee6fd31-2a24-4a96-abeb-86d77dcfe78d tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1721 microversion: 2.20 time: 0.164724 Jul 04 10:15:20.822830 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 397/789] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:15:20 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:15:21.568732 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-364fa6b9-d2a7-4c66-b34a-2cc8ce660396 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] Calling method '.version_select at 0x7f2802eaf0d0>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:21.601374 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-364fa6b9-d2a7-4c66-b34a-2cc8ce660396 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/6b4f4074-2f71-4727-b6da-5e116edfd572" status: 200 len: 287 microversion: 2.1 time: 0.038822 Jul 04 10:15:21.602025 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 393/790] 10.222.0.79 () {58 vars in 1250 bytes} [Mon Jul 4 10:15:21 2022] GET /compute/v2.1/os-snapshots/6b4f4074-2f71-4727-b6da-5e116edfd572 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:15:21.841195 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-be3cabc2-6da7-42f6-a1ea-e593492f57a7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:21.841899 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-be3cabc2-6da7-42f6-a1ea-e593492f57a7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:21.850692 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-be3cabc2-6da7-42f6-a1ea-e593492f57a7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:21.851151 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-be3cabc2-6da7-42f6-a1ea-e593492f57a7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:21.852773 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-be3cabc2-6da7-42f6-a1ea-e593492f57a7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:21.852773 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-be3cabc2-6da7-42f6-a1ea-e593492f57a7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:22.004728 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-be3cabc2-6da7-42f6-a1ea-e593492f57a7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:22.014410 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-be3cabc2-6da7-42f6-a1ea-e593492f57a7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:22.015856 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-be3cabc2-6da7-42f6-a1ea-e593492f57a7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:22.017139 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-be3cabc2-6da7-42f6-a1ea-e593492f57a7 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1721 microversion: 2.20 time: 0.180170 Jul 04 10:15:22.017749 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 398/791] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:15:21 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:15:22.615415 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-6748727c-20cd-4530-9078-99126bf7cab7 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] Calling method '.version_select at 0x7f2802e3fa60>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:22.645720 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-6748727c-20cd-4530-9078-99126bf7cab7 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/6b4f4074-2f71-4727-b6da-5e116edfd572" status: 200 len: 287 microversion: 2.1 time: 0.034635 Jul 04 10:15:22.646307 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 394/792] 10.222.0.79 () {58 vars in 1250 bytes} [Mon Jul 4 10:15:22 2022] GET /compute/v2.1/os-snapshots/6b4f4074-2f71-4727-b6da-5e116edfd572 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:15:23.040510 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-b25481f7-e005-4c55-bc89-f957a873002e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:23.041140 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-b25481f7-e005-4c55-bc89-f957a873002e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:23.048630 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b25481f7-e005-4c55-bc89-f957a873002e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:23.049101 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b25481f7-e005-4c55-bc89-f957a873002e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:23.049948 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b25481f7-e005-4c55-bc89-f957a873002e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:23.050404 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b25481f7-e005-4c55-bc89-f957a873002e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:23.185710 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-b25481f7-e005-4c55-bc89-f957a873002e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:23.197705 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-b25481f7-e005-4c55-bc89-f957a873002e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:23.199981 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-b25481f7-e005-4c55-bc89-f957a873002e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:23.201704 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-b25481f7-e005-4c55-bc89-f957a873002e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1721 microversion: 2.20 time: 0.166986 Jul 04 10:15:23.202498 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 399/793] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:15:23 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 10:15:23.658462 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-246465ce-4c97-45ef-b3bd-3ece5125d42b tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] Calling method '.version_select at 0x7f2802eaf430>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:23.688783 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-246465ce-4c97-45ef-b3bd-3ece5125d42b tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/6b4f4074-2f71-4727-b6da-5e116edfd572" status: 200 len: 287 microversion: 2.1 time: 0.034679 Jul 04 10:15:23.689335 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 395/794] 10.222.0.79 () {58 vars in 1250 bytes} [Mon Jul 4 10:15:23 2022] GET /compute/v2.1/os-snapshots/6b4f4074-2f71-4727-b6da-5e116edfd572 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:15:24.189427 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-a8516346-9df5-4f7f-a094-5fcbbcac96c0 req-ee659a72-a670-4915-9cf8-40df60653a45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a66cd362-4fe8-499f-850d-6755bd23c668", "name": "network-vif-deleted", "tag": "4f41751d-4044-46c9-8fe9-0a9fdf5d5a79"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:15:24.198950 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-a8516346-9df5-4f7f-a094-5fcbbcac96c0 req-ee659a72-a670-4915-9cf8-40df60653a45 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:24.199381 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-a8516346-9df5-4f7f-a094-5fcbbcac96c0 req-ee659a72-a670-4915-9cf8-40df60653a45 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:24.213439 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-a8516346-9df5-4f7f-a094-5fcbbcac96c0 req-ee659a72-a670-4915-9cf8-40df60653a45 service nova] Creating event network-vif-deleted:4f41751d-4044-46c9-8fe9-0a9fdf5d5a79 for instance a66cd362-4fe8-499f-850d-6755bd23c668 on hv-cinder-84841 Jul 04 10:15:24.219820 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-a8516346-9df5-4f7f-a094-5fcbbcac96c0 req-ee659a72-a670-4915-9cf8-40df60653a45 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034333 Jul 04 10:15:24.220335 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-68e5640f-0aca-4698-ace0-fac65a91e35e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:24.220858 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 400/795] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:15:24.221063 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-68e5640f-0aca-4698-ace0-fac65a91e35e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:24.228121 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-68e5640f-0aca-4698-ace0-fac65a91e35e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:24.228637 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-68e5640f-0aca-4698-ace0-fac65a91e35e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:24.229419 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-68e5640f-0aca-4698-ace0-fac65a91e35e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:24.229878 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-68e5640f-0aca-4698-ace0-fac65a91e35e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:24.304921 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-68e5640f-0aca-4698-ace0-fac65a91e35e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:24.314261 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-68e5640f-0aca-4698-ace0-fac65a91e35e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:24.315738 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-68e5640f-0aca-4698-ace0-fac65a91e35e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c05b9b08df0437f9b0abb167d17aa56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b852926ec18f4dc695da5ec1c5582f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:24.317276 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-68e5640f-0aca-4698-ace0-fac65a91e35e tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 200 len: 1367 microversion: 2.20 time: 0.100817 Jul 04 10:15:24.328366 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 396/796] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:15:24 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 1367 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 10:15:24.701125 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-10c092e9-4256-416b-baf9-f833b43a6afa tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] Calling method '.version_select at 0x7f2802fca4c0>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:24.732527 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-10c092e9-4256-416b-baf9-f833b43a6afa tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/6b4f4074-2f71-4727-b6da-5e116edfd572" status: 200 len: 287 microversion: 2.1 time: 0.035567 Jul 04 10:15:24.733108 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 401/797] 10.222.0.79 () {58 vars in 1250 bytes} [Mon Jul 4 10:15:24 2022] GET /compute/v2.1/os-snapshots/6b4f4074-2f71-4727-b6da-5e116edfd572 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:15:25.335818 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-98c37c43-8197-4fe3-abcf-f2a74f53391c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:25.336422 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-98c37c43-8197-4fe3-abcf-f2a74f53391c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:25.344101 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-98c37c43-8197-4fe3-abcf-f2a74f53391c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:25.344566 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-98c37c43-8197-4fe3-abcf-f2a74f53391c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:25.345334 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-98c37c43-8197-4fe3-abcf-f2a74f53391c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:25.345813 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-98c37c43-8197-4fe3-abcf-f2a74f53391c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:25.360021 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-98c37c43-8197-4fe3-abcf-f2a74f53391c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] HTTP exception thrown: Instance a66cd362-4fe8-499f-850d-6755bd23c668 could not be found. Jul 04 10:15:25.361676 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-98c37c43-8197-4fe3-abcf-f2a74f53391c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Request method failure captured: Jul 04 10:15:25.361676 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: request: GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 HTTP/1.1 Jul 04 10:15:25.361676 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept: application/json Jul 04 10:15:25.361676 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept-Encoding: identity Jul 04 10:15:25.361676 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Connection: close Jul 04 10:15:25.361676 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Length: 0 Jul 04 10:15:25.361676 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Type: application/json Jul 04 10:15:25.361676 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Host: 10.222.0.79 Jul 04 10:15:25.361676 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 04 10:15:25.361676 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 04 10:15:25.361676 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Auth-Token: gAAAAABiwrwsRjPFfauJ0cIzMInBcEwtVng9DptjB6OPKNfVygqH0eCVAApJP28q3UyvJOOyf4svKw5vjRunfIOFo_QaQJeMPe34oQOw61-tXGDN64BxOzNizWTxQ-yvVdFgXtg5_SGTWj_hasuWYs2yuFpQLMypxGx5O68Q-1MWK1ukE3GPXaM Jul 04 10:15:25.361676 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Id: None Jul 04 10:15:25.361676 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Name: None Jul 04 10:15:25.361676 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 04 10:15:25.361676 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 04 10:15:25.361676 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Openstack-Nova-Api-Version: 2.20 Jul 04 10:15:25.361676 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 04 10:15:25.361676 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 04 10:15:25.361676 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Id: b852926ec18f4dc695da5ec1c5582f48 Jul 04 10:15:25.361676 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1729716423 Jul 04 10:15:25.361676 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Role: reader,member Jul 04 10:15:25.361676 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Roles: reader,member Jul 04 10:15:25.363649 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b852926ec18f4dc695da5ec1c5582f48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b852926ec18f4dc695da5ec1c5582f48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b852926ec18f4dc695da5ec1c5582f48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b852926ec18f4dc695da5ec1c5582f48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:15:25.363649 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1729716423 Jul 04 10:15:25.363649 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Id: b852926ec18f4dc695da5ec1c5582f48 Jul 04 10:15:25.363649 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1729716423 Jul 04 10:15:25.363649 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User: tempest-AttachVolumeShelveTestJSON-1729716423-project Jul 04 10:15:25.363649 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 04 10:15:25.363649 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 04 10:15:25.363649 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Id: 1c05b9b08df0437f9b0abb167d17aa56 Jul 04 10:15:25.363649 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1729716423-project Jul 04 10:15:25.363649 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: method: > Jul 04 10:15:25.363649 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: exception: Instance a66cd362-4fe8-499f-850d-6755bd23c668 could not be found. Jul 04 10:15:25.363649 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: action_args: {'id': 'a66cd362-4fe8-499f-850d-6755bd23c668'} Jul 04 10:15:25.364531 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:15:25.364531 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:25.364531 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:15:25.364531 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:15:25.364531 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:15:25.364531 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:15:25.364531 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:15:25.364531 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:15:25.364531 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:15:25.364531 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:15:25.364531 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a66cd362-4fe8-499f-850d-6755bd23c668 could not be found. Jul 04 10:15:25.364531 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:25.364531 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:25.364531 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:25.364531 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:25.364531 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:25.364531 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:25.364531 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:15:25.364531 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:15:25.364531 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:15:25.366263 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:15:25.366263 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 10:15:25.366263 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 10:15:25.366263 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:15:25.366263 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:15:25.366263 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:15:25.366263 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:15:25.366263 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a66cd362-4fe8-499f-850d-6755bd23c668 could not be found. Jul 04 10:15:25.366263 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:25.366263 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:25.366263 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:25.366263 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:25.366263 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:25.366263 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:25.366263 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:15:25.366263 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:15:25.366263 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a66cd362-4fe8-499f-850d-6755bd23c668 could not be found. Jul 04 10:15:25.366263 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:25.369055 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-98c37c43-8197-4fe3-abcf-f2a74f53391c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Returning 404 to user: Instance a66cd362-4fe8-499f-850d-6755bd23c668 could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:15:25.369055 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-98c37c43-8197-4fe3-abcf-f2a74f53391c tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 404 len: 111 microversion: 2.20 time: 0.031361 Jul 04 10:15:25.369055 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 397/798] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:15:25 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 04 10:15:25.372861 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-979d978b-a2fd-457a-abf9-a0e3f14a85d5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '.version_select at 0x7f2802fb8550>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:25.392562 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-979d978b-a2fd-457a-abf9-a0e3f14a85d5 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1741992777" status: 204 len: 0 microversion: 2.20 time: 0.023919 Jul 04 10:15:25.393150 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 402/799] 10.222.0.79 () {60 vars in 1261 bytes} [Mon Jul 4 10:15:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1741992777 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 04 10:15:25.744813 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-16345b8c-d797-4e95-8e48-8a528c1c577a tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] Calling method '.version_select at 0x7f2802eb8670>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:25.777830 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-16345b8c-d797-4e95-8e48-8a528c1c577a tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/6b4f4074-2f71-4727-b6da-5e116edfd572" status: 200 len: 288 microversion: 2.1 time: 0.037171 Jul 04 10:15:25.788919 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-9cd1f1a4-bc31-4c66-88c6-5eb5f5a265c9 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] Calling method '.version_select at 0x7f2802f34310>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:25.789831 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 398/800] 10.222.0.79 () {58 vars in 1250 bytes} [Mon Jul 4 10:15:25 2022] GET /compute/v2.1/os-snapshots/6b4f4074-2f71-4727-b6da-5e116edfd572 => generated 288 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:15:25.854223 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-9cd1f1a4-bc31-4c66-88c6-5eb5f5a265c9 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] 10.222.0.79 "DELETE /compute/v2.1/os-snapshots/6b4f4074-2f71-4727-b6da-5e116edfd572" status: 202 len: 0 microversion: 2.1 time: 0.069123 Jul 04 10:15:25.857677 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 403/801] 10.222.0.79 () {58 vars in 1253 bytes} [Mon Jul 4 10:15:25 2022] DELETE /compute/v2.1/os-snapshots/6b4f4074-2f71-4727-b6da-5e116edfd572 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 10:15:25.866457 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2e666342-972f-4612-91c8-e802f72e3537 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] Calling method '.version_select at 0x7f2802eb88b0>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:25.905215 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-2e666342-972f-4612-91c8-e802f72e3537 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/6b4f4074-2f71-4727-b6da-5e116edfd572" status: 200 len: 287 microversion: 2.1 time: 0.045124 Jul 04 10:15:25.909658 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 399/802] 10.222.0.79 () {58 vars in 1250 bytes} [Mon Jul 4 10:15:25 2022] GET /compute/v2.1/os-snapshots/6b4f4074-2f71-4727-b6da-5e116edfd572 => generated 287 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:15:26.918994 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-44c6697b-c78a-4c64-b330-70dcc5284c5e tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] Calling method '.version_select at 0x7f2802fcaa60>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:26.963417 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-44c6697b-c78a-4c64-b330-70dcc5284c5e tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/6b4f4074-2f71-4727-b6da-5e116edfd572" status: 200 len: 287 microversion: 2.1 time: 0.049595 Jul 04 10:15:26.963999 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 404/803] 10.222.0.79 () {58 vars in 1250 bytes} [Mon Jul 4 10:15:26 2022] GET /compute/v2.1/os-snapshots/6b4f4074-2f71-4727-b6da-5e116edfd572 => generated 287 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:15:27.979035 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f9fa9df8-881a-4171-bed1-1f0e4e78d98e tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] Calling method '.version_select at 0x7f2802f98280>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:28.009262 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f9fa9df8-881a-4171-bed1-1f0e4e78d98e tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/6b4f4074-2f71-4727-b6da-5e116edfd572" status: 200 len: 287 microversion: 2.1 time: 0.037381 Jul 04 10:15:28.010039 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 400/804] 10.222.0.79 () {58 vars in 1250 bytes} [Mon Jul 4 10:15:27 2022] GET /compute/v2.1/os-snapshots/6b4f4074-2f71-4727-b6da-5e116edfd572 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:15:29.023716 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-05cc3efb-1700-4780-9ed7-39acfd9a5795 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] Calling method '.version_select at 0x7f2802f3b1f0>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:29.049208 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.wsgi [None req-05cc3efb-1700-4780-9ed7-39acfd9a5795 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] HTTP exception thrown: Snapshot 6b4f4074-2f71-4727-b6da-5e116edfd572 could not be found. Jul 04 10:15:29.051551 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-05cc3efb-1700-4780-9ed7-39acfd9a5795 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] Request method failure captured: Jul 04 10:15:29.051551 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: request: GET /compute/v2.1/os-snapshots/6b4f4074-2f71-4727-b6da-5e116edfd572 HTTP/1.1 Jul 04 10:15:29.051551 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept: application/json Jul 04 10:15:29.051551 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept-Encoding: identity Jul 04 10:15:29.051551 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Connection: close Jul 04 10:15:29.051551 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Length: 0 Jul 04 10:15:29.051551 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Type: application/json Jul 04 10:15:29.051551 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Host: 10.222.0.79 Jul 04 10:15:29.051551 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Openstack-System-Scope: None Jul 04 10:15:29.051551 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: User-Agent: python-urllib3/1.26.9 Jul 04 10:15:29.051551 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Auth-Token: gAAAAABiwr2zwHmzmijKq98pFKLcguZP98ADti3cMAhF1uTy0vIxrO1duaoEFlrlOai7iFff4i1zVo_m4armEFiy4IeU_kVpjvsdJG70UU0B0xJXSI5h9_kEswPxaphhknDfuN51clWA0m7nQMu2otWETTI3hFVnfe0aHh-BRwD5ZE1efJxTF7M Jul 04 10:15:29.051551 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Id: None Jul 04 10:15:29.051551 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Name: None Jul 04 10:15:29.051551 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Identity-Status: Confirmed Jul 04 10:15:29.051551 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Is-Admin-Project: True Jul 04 10:15:29.051551 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Id: default Jul 04 10:15:29.051551 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Name: Default Jul 04 10:15:29.051551 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Id: e1ae2bf7ed184f7a99c784aececd1d15 Jul 04 10:15:29.051551 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-957178585 Jul 04 10:15:29.051551 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Role: reader,member Jul 04 10:15:29.051551 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Roles: reader,member Jul 04 10:15:29.053054 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e1ae2bf7ed184f7a99c784aececd1d15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e1ae2bf7ed184f7a99c784aececd1d15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e1ae2bf7ed184f7a99c784aececd1d15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e1ae2bf7ed184f7a99c784aececd1d15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:15:29.053054 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant: tempest-VolumesSnapshotsTestJSON-957178585 Jul 04 10:15:29.053054 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Id: e1ae2bf7ed184f7a99c784aececd1d15 Jul 04 10:15:29.053054 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-957178585 Jul 04 10:15:29.053054 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User: tempest-VolumesSnapshotsTestJSON-957178585-project Jul 04 10:15:29.053054 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Id: default Jul 04 10:15:29.053054 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Name: Default Jul 04 10:15:29.053054 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Id: 044f8d0a53dd435480778bd8bf291b50 Jul 04 10:15:29.053054 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Name: tempest-VolumesSnapshotsTestJSON-957178585-project Jul 04 10:15:29.053054 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: method: Jul 04 10:15:29.053054 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: exception: Snapshot 6b4f4074-2f71-4727-b6da-5e116edfd572 could not be found. Jul 04 10:15:29.053054 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: action_args: {'id': '6b4f4074-2f71-4727-b6da-5e116edfd572'} Jul 04 10:15:29.053054 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:15:29.054035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:29.054035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 04 10:15:29.054035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 04 10:15:29.054035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 04 10:15:29.054035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 04 10:15:29.054035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 04 10:15:29.054035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 04 10:15:29.054035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 10:15:29.054035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 10:15:29.054035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 10:15:29.054035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 10:15:29.054035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 10:15:29.054035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 10:15:29.054035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 10:15:29.054035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 10:15:29.054035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6b4f4074-2f71-4727-b6da-5e116edfd572 could not be found. (HTTP 404) (Request-ID: req-f8ecb3e0-4270-42b8-8217-6e7d623218a8) Jul 04 10:15:29.054035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:29.054035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:29.055148 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:29.055148 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:29.055148 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 04 10:15:29.055148 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 04 10:15:29.055148 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 10:15:29.055148 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 10:15:29.055148 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 04 10:15:29.055148 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 04 10:15:29.055148 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 10:15:29.055148 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 10:15:29.055148 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 04 10:15:29.055148 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 04 10:15:29.055148 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 04 10:15:29.055148 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 04 10:15:29.055148 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 04 10:15:29.055148 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 04 10:15:29.055148 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 10:15:29.055148 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 10:15:29.055148 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 10:15:29.056256 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 10:15:29.056256 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 10:15:29.056256 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 10:15:29.056256 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 10:15:29.056256 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 10:15:29.056256 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6b4f4074-2f71-4727-b6da-5e116edfd572 could not be found. Jul 04 10:15:29.056256 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:29.056256 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:29.056256 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:29.056256 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:29.056256 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:29.056256 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:29.056256 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:15:29.056256 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:15:29.056256 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 10:15:29.056256 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 10:15:29.056256 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:15:29.056256 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:15:29.056256 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 04 10:15:29.056256 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:15:29.057434 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6b4f4074-2f71-4727-b6da-5e116edfd572 could not be found. Jul 04 10:15:29.057434 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:29.057434 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:29.057434 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:29.057434 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:29.057434 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:29.057434 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:29.057434 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:15:29.057434 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:15:29.057434 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6b4f4074-2f71-4727-b6da-5e116edfd572 could not be found. Jul 04 10:15:29.057434 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:29.057434 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-05cc3efb-1700-4780-9ed7-39acfd9a5795 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] Returning 404 to user: Snapshot 6b4f4074-2f71-4727-b6da-5e116edfd572 could not be found. {{(pid=117866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:15:29.057434 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-05cc3efb-1700-4780-9ed7-39acfd9a5795 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/6b4f4074-2f71-4727-b6da-5e116edfd572" status: 404 len: 111 microversion: 2.1 time: 0.033663 Jul 04 10:15:29.057434 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 405/805] 10.222.0.79 () {58 vars in 1250 bytes} [Mon Jul 4 10:15:29 2022] GET /compute/v2.1/os-snapshots/6b4f4074-2f71-4727-b6da-5e116edfd572 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:15:29.062438 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-1af593db-e06c-43e5-b050-c780d7ed5fd5 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] Calling method '.version_select at 0x7f2802ef84c0>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:29.139887 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-1af593db-e06c-43e5-b050-c780d7ed5fd5 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/e02274ca-bfd5-4d77-86b8-539db2fbcfb3" status: 202 len: 0 microversion: 2.1 time: 0.081929 Jul 04 10:15:29.140618 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 401/806] 10.222.0.79 () {58 vars in 1247 bytes} [Mon Jul 4 10:15:29 2022] DELETE /compute/v2.1/os-volumes/e02274ca-bfd5-4d77-86b8-539db2fbcfb3 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 04 10:15:29.148904 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-d6880144-573a-4930-a294-1f7b08cae5b7 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] Calling method '.version_select at 0x7f2802fca040>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:29.197389 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-d6880144-573a-4930-a294-1f7b08cae5b7 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/e02274ca-bfd5-4d77-86b8-539db2fbcfb3" status: 200 len: 345 microversion: 2.1 time: 0.052256 Jul 04 10:15:29.197998 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 406/807] 10.222.0.79 () {58 vars in 1244 bytes} [Mon Jul 4 10:15:29 2022] GET /compute/v2.1/os-volumes/e02274ca-bfd5-4d77-86b8-539db2fbcfb3 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:15:29.294122 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-1b1fa584-8b9c-4d7d-9cfd-91040bcd59a3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:29.294596 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-1b1fa584-8b9c-4d7d-9cfd-91040bcd59a3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:29.300931 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1b1fa584-8b9c-4d7d-9cfd-91040bcd59a3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:29.301371 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1b1fa584-8b9c-4d7d-9cfd-91040bcd59a3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:29.302160 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1b1fa584-8b9c-4d7d-9cfd-91040bcd59a3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:29.302587 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1b1fa584-8b9c-4d7d-9cfd-91040bcd59a3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:29.318637 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-1b1fa584-8b9c-4d7d-9cfd-91040bcd59a3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] HTTP exception thrown: Instance a66cd362-4fe8-499f-850d-6755bd23c668 could not be found. Jul 04 10:15:29.320221 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-1b1fa584-8b9c-4d7d-9cfd-91040bcd59a3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Request method failure captured: Jul 04 10:15:29.320221 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: request: DELETE /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 HTTP/1.1 Jul 04 10:15:29.320221 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept: application/json Jul 04 10:15:29.320221 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept-Encoding: identity Jul 04 10:15:29.320221 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Connection: close Jul 04 10:15:29.320221 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Length: 0 Jul 04 10:15:29.320221 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Type: application/json Jul 04 10:15:29.320221 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Host: 10.222.0.79 Jul 04 10:15:29.320221 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 04 10:15:29.320221 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 04 10:15:29.320221 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Auth-Token: gAAAAABiwrwsRjPFfauJ0cIzMInBcEwtVng9DptjB6OPKNfVygqH0eCVAApJP28q3UyvJOOyf4svKw5vjRunfIOFo_QaQJeMPe34oQOw61-tXGDN64BxOzNizWTxQ-yvVdFgXtg5_SGTWj_hasuWYs2yuFpQLMypxGx5O68Q-1MWK1ukE3GPXaM Jul 04 10:15:29.320221 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Id: None Jul 04 10:15:29.320221 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Name: None Jul 04 10:15:29.320221 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 04 10:15:29.320221 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 04 10:15:29.320221 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Openstack-Nova-Api-Version: 2.20 Jul 04 10:15:29.320221 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 04 10:15:29.320221 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 04 10:15:29.320221 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Id: b852926ec18f4dc695da5ec1c5582f48 Jul 04 10:15:29.320221 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1729716423 Jul 04 10:15:29.320221 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Role: reader,member Jul 04 10:15:29.320221 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Roles: reader,member Jul 04 10:15:29.321936 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b852926ec18f4dc695da5ec1c5582f48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b852926ec18f4dc695da5ec1c5582f48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b852926ec18f4dc695da5ec1c5582f48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b852926ec18f4dc695da5ec1c5582f48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:15:29.321936 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1729716423 Jul 04 10:15:29.321936 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Id: b852926ec18f4dc695da5ec1c5582f48 Jul 04 10:15:29.321936 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1729716423 Jul 04 10:15:29.321936 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User: tempest-AttachVolumeShelveTestJSON-1729716423-project Jul 04 10:15:29.321936 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 04 10:15:29.321936 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 04 10:15:29.321936 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Id: 1c05b9b08df0437f9b0abb167d17aa56 Jul 04 10:15:29.321936 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1729716423-project Jul 04 10:15:29.321936 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: method: > Jul 04 10:15:29.321936 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: exception: Instance a66cd362-4fe8-499f-850d-6755bd23c668 could not be found. Jul 04 10:15:29.321936 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: action_args: {'id': 'a66cd362-4fe8-499f-850d-6755bd23c668'} Jul 04 10:15:29.322721 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:15:29.322721 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:29.322721 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:15:29.322721 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:15:29.322721 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:15:29.322721 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:15:29.322721 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:15:29.322721 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:15:29.322721 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:15:29.322721 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:15:29.322721 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a66cd362-4fe8-499f-850d-6755bd23c668 could not be found. Jul 04 10:15:29.322721 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:29.322721 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:29.322721 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:29.322721 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:29.322721 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:29.322721 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:29.322721 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:15:29.322721 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:15:29.322721 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:15:29.323929 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:15:29.323929 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 10:15:29.323929 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 10:15:29.323929 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 10:15:29.323929 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 10:15:29.323929 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:15:29.323929 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:15:29.323929 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:15:29.323929 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:15:29.323929 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a66cd362-4fe8-499f-850d-6755bd23c668 could not be found. Jul 04 10:15:29.323929 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:29.323929 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:29.323929 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:29.323929 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:29.323929 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:29.323929 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:29.323929 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:15:29.323929 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:15:29.323929 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a66cd362-4fe8-499f-850d-6755bd23c668 could not be found. Jul 04 10:15:29.323929 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:29.325129 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-1b1fa584-8b9c-4d7d-9cfd-91040bcd59a3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Returning 404 to user: Instance a66cd362-4fe8-499f-850d-6755bd23c668 could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:15:29.325129 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-1b1fa584-8b9c-4d7d-9cfd-91040bcd59a3 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 404 len: 111 microversion: 2.20 time: 0.031312 Jul 04 10:15:29.325129 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 402/808] 10.222.0.79 () {60 vars in 1279 bytes} [Mon Jul 4 10:15:29 2022] DELETE /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 04 10:15:29.330494 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-cbff641f-6c78-44a8-8cfb-b8730d3b7baf tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:29.331233 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-cbff641f-6c78-44a8-8cfb-b8730d3b7baf tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: a66cd362-4fe8-499f-850d-6755bd23c668] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:29.338743 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-cbff641f-6c78-44a8-8cfb-b8730d3b7baf tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:29.339179 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-cbff641f-6c78-44a8-8cfb-b8730d3b7baf tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:29.339924 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-cbff641f-6c78-44a8-8cfb-b8730d3b7baf tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:29.340366 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-cbff641f-6c78-44a8-8cfb-b8730d3b7baf tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:29.354036 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.wsgi [None req-cbff641f-6c78-44a8-8cfb-b8730d3b7baf tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] HTTP exception thrown: Instance a66cd362-4fe8-499f-850d-6755bd23c668 could not be found. Jul 04 10:15:29.355592 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-cbff641f-6c78-44a8-8cfb-b8730d3b7baf tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Request method failure captured: Jul 04 10:15:29.355592 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: request: GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 HTTP/1.1 Jul 04 10:15:29.355592 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept: application/json Jul 04 10:15:29.355592 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept-Encoding: identity Jul 04 10:15:29.355592 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Connection: close Jul 04 10:15:29.355592 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Length: 0 Jul 04 10:15:29.355592 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Type: application/json Jul 04 10:15:29.355592 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Host: 10.222.0.79 Jul 04 10:15:29.355592 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Openstack-System-Scope: None Jul 04 10:15:29.355592 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: User-Agent: python-urllib3/1.26.9 Jul 04 10:15:29.355592 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Auth-Token: gAAAAABiwrwsRjPFfauJ0cIzMInBcEwtVng9DptjB6OPKNfVygqH0eCVAApJP28q3UyvJOOyf4svKw5vjRunfIOFo_QaQJeMPe34oQOw61-tXGDN64BxOzNizWTxQ-yvVdFgXtg5_SGTWj_hasuWYs2yuFpQLMypxGx5O68Q-1MWK1ukE3GPXaM Jul 04 10:15:29.355592 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Id: None Jul 04 10:15:29.355592 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Name: None Jul 04 10:15:29.355592 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Identity-Status: Confirmed Jul 04 10:15:29.355592 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Is-Admin-Project: True Jul 04 10:15:29.355592 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Openstack-Nova-Api-Version: 2.20 Jul 04 10:15:29.355592 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Id: default Jul 04 10:15:29.355592 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Name: Default Jul 04 10:15:29.355592 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Id: b852926ec18f4dc695da5ec1c5582f48 Jul 04 10:15:29.355592 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1729716423 Jul 04 10:15:29.355592 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Role: reader,member Jul 04 10:15:29.355592 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Roles: reader,member Jul 04 10:15:29.357186 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b852926ec18f4dc695da5ec1c5582f48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b852926ec18f4dc695da5ec1c5582f48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b852926ec18f4dc695da5ec1c5582f48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b852926ec18f4dc695da5ec1c5582f48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:15:29.357186 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1729716423 Jul 04 10:15:29.357186 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Id: b852926ec18f4dc695da5ec1c5582f48 Jul 04 10:15:29.357186 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1729716423 Jul 04 10:15:29.357186 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User: tempest-AttachVolumeShelveTestJSON-1729716423-project Jul 04 10:15:29.357186 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Id: default Jul 04 10:15:29.357186 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Name: Default Jul 04 10:15:29.357186 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Id: 1c05b9b08df0437f9b0abb167d17aa56 Jul 04 10:15:29.357186 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1729716423-project Jul 04 10:15:29.357186 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: method: > Jul 04 10:15:29.357186 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: exception: Instance a66cd362-4fe8-499f-850d-6755bd23c668 could not be found. Jul 04 10:15:29.357186 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: action_args: {'id': 'a66cd362-4fe8-499f-850d-6755bd23c668'} Jul 04 10:15:29.358147 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:15:29.358147 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:29.358147 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:15:29.358147 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:15:29.358147 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:15:29.358147 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:15:29.358147 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:15:29.358147 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:15:29.358147 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:15:29.358147 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:15:29.358147 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a66cd362-4fe8-499f-850d-6755bd23c668 could not be found. Jul 04 10:15:29.358147 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:29.358147 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:29.358147 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:29.358147 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:29.358147 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:29.358147 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:29.358147 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:15:29.358147 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:15:29.358147 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:15:29.359963 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:15:29.359963 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 10:15:29.359963 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 10:15:29.359963 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:15:29.359963 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:15:29.359963 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:15:29.359963 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:15:29.359963 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a66cd362-4fe8-499f-850d-6755bd23c668 could not be found. Jul 04 10:15:29.359963 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:29.359963 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:29.359963 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:29.359963 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:29.359963 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:29.359963 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:29.359963 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:15:29.359963 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:15:29.359963 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a66cd362-4fe8-499f-850d-6755bd23c668 could not be found. Jul 04 10:15:29.359963 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:29.361385 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-cbff641f-6c78-44a8-8cfb-b8730d3b7baf tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Returning 404 to user: Instance a66cd362-4fe8-499f-850d-6755bd23c668 could not be found. {{(pid=117866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:15:29.361385 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-cbff641f-6c78-44a8-8cfb-b8730d3b7baf tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668" status: 404 len: 111 microversion: 2.20 time: 0.030420 Jul 04 10:15:29.361385 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 407/809] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:15:29 2022] GET /compute/v2.1/servers/a66cd362-4fe8-499f-850d-6755bd23c668 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 04 10:15:30.214871 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-ea1bc6d5-bcf6-40ea-bc23-fb60e5cad6dd tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] Calling method '.version_select at 0x7f2802ed4af0>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:30.251841 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-ea1bc6d5-bcf6-40ea-bc23-fb60e5cad6dd tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] HTTP exception thrown: Volume e02274ca-bfd5-4d77-86b8-539db2fbcfb3 could not be found. Jul 04 10:15:30.253795 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-ea1bc6d5-bcf6-40ea-bc23-fb60e5cad6dd tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] Request method failure captured: Jul 04 10:15:30.253795 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: request: GET /compute/v2.1/os-volumes/e02274ca-bfd5-4d77-86b8-539db2fbcfb3 HTTP/1.1 Jul 04 10:15:30.253795 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept: application/json Jul 04 10:15:30.253795 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept-Encoding: identity Jul 04 10:15:30.253795 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Connection: close Jul 04 10:15:30.253795 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Length: 0 Jul 04 10:15:30.253795 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Type: application/json Jul 04 10:15:30.253795 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Host: 10.222.0.79 Jul 04 10:15:30.253795 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 04 10:15:30.253795 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 04 10:15:30.253795 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Auth-Token: gAAAAABiwr2zwHmzmijKq98pFKLcguZP98ADti3cMAhF1uTy0vIxrO1duaoEFlrlOai7iFff4i1zVo_m4armEFiy4IeU_kVpjvsdJG70UU0B0xJXSI5h9_kEswPxaphhknDfuN51clWA0m7nQMu2otWETTI3hFVnfe0aHh-BRwD5ZE1efJxTF7M Jul 04 10:15:30.253795 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Id: None Jul 04 10:15:30.253795 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Name: None Jul 04 10:15:30.253795 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 04 10:15:30.253795 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 04 10:15:30.253795 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 04 10:15:30.253795 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 04 10:15:30.253795 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Id: e1ae2bf7ed184f7a99c784aececd1d15 Jul 04 10:15:30.253795 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-957178585 Jul 04 10:15:30.253795 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Role: reader,member Jul 04 10:15:30.253795 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Roles: reader,member Jul 04 10:15:30.255256 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e1ae2bf7ed184f7a99c784aececd1d15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e1ae2bf7ed184f7a99c784aececd1d15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e1ae2bf7ed184f7a99c784aececd1d15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e1ae2bf7ed184f7a99c784aececd1d15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:15:30.255256 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant: tempest-VolumesSnapshotsTestJSON-957178585 Jul 04 10:15:30.255256 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Id: e1ae2bf7ed184f7a99c784aececd1d15 Jul 04 10:15:30.255256 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-957178585 Jul 04 10:15:30.255256 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User: tempest-VolumesSnapshotsTestJSON-957178585-project Jul 04 10:15:30.255256 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 04 10:15:30.255256 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 04 10:15:30.255256 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Id: 044f8d0a53dd435480778bd8bf291b50 Jul 04 10:15:30.255256 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Name: tempest-VolumesSnapshotsTestJSON-957178585-project Jul 04 10:15:30.255256 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: method: Jul 04 10:15:30.255256 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: exception: Volume e02274ca-bfd5-4d77-86b8-539db2fbcfb3 could not be found. Jul 04 10:15:30.255256 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: action_args: {'id': 'e02274ca-bfd5-4d77-86b8-539db2fbcfb3'} Jul 04 10:15:30.255256 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:15:30.256165 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:30.256165 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 10:15:30.256165 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 10:15:30.256165 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 10:15:30.256165 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 10:15:30.256165 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 10:15:30.256165 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 10:15:30.256165 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 10:15:30.256165 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 10:15:30.256165 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 10:15:30.256165 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 10:15:30.256165 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 10:15:30.256165 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 10:15:30.256165 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 10:15:30.256165 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 10:15:30.256165 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e02274ca-bfd5-4d77-86b8-539db2fbcfb3 could not be found. (HTTP 404) (Request-ID: req-434efa3b-7c34-447d-99c0-e9cc42271967) Jul 04 10:15:30.256165 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:30.256165 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:30.256165 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:30.257731 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:30.257731 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 04 10:15:30.257731 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 04 10:15:30.257731 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 10:15:30.257731 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 10:15:30.257731 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 10:15:30.257731 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 10:15:30.257731 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 10:15:30.257731 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 10:15:30.257731 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 10:15:30.257731 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 10:15:30.257731 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 10:15:30.257731 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 10:15:30.257731 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 10:15:30.257731 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 10:15:30.257731 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 10:15:30.257731 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 10:15:30.257731 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 10:15:30.257731 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 10:15:30.259316 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 10:15:30.259316 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 10:15:30.259316 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 10:15:30.259316 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 10:15:30.259316 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e02274ca-bfd5-4d77-86b8-539db2fbcfb3 could not be found. Jul 04 10:15:30.259316 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:30.259316 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:30.259316 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:30.259316 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:30.259316 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:30.259316 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:30.259316 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:15:30.259316 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:15:30.259316 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 10:15:30.259316 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 10:15:30.259316 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:15:30.259316 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:15:30.259316 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 04 10:15:30.259316 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:15:30.261118 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e02274ca-bfd5-4d77-86b8-539db2fbcfb3 could not be found. Jul 04 10:15:30.261118 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:30.261118 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:30.261118 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:30.261118 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:30.261118 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:30.261118 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:30.261118 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:15:30.261118 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:15:30.261118 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e02274ca-bfd5-4d77-86b8-539db2fbcfb3 could not be found. Jul 04 10:15:30.261118 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:30.261118 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-ea1bc6d5-bcf6-40ea-bc23-fb60e5cad6dd tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] Returning 404 to user: Volume e02274ca-bfd5-4d77-86b8-539db2fbcfb3 could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:15:30.261118 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-ea1bc6d5-bcf6-40ea-bc23-fb60e5cad6dd tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/e02274ca-bfd5-4d77-86b8-539db2fbcfb3" status: 404 len: 109 microversion: 2.1 time: 0.047259 Jul 04 10:15:30.261118 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 403/810] 10.222.0.79 () {58 vars in 1244 bytes} [Mon Jul 4 10:15:30 2022] GET /compute/v2.1/os-volumes/e02274ca-bfd5-4d77-86b8-539db2fbcfb3 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:15:30.270500 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-c87b1d41-fd1e-4b60-9a12-5fda84654d3c tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] Calling method '.version_select at 0x7f2802fdaf70>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:30.300020 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.wsgi [None req-c87b1d41-fd1e-4b60-9a12-5fda84654d3c tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] HTTP exception thrown: Volume e02274ca-bfd5-4d77-86b8-539db2fbcfb3 could not be found. Jul 04 10:15:30.302119 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-c87b1d41-fd1e-4b60-9a12-5fda84654d3c tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] Request method failure captured: Jul 04 10:15:30.302119 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: request: DELETE /compute/v2.1/os-volumes/e02274ca-bfd5-4d77-86b8-539db2fbcfb3 HTTP/1.1 Jul 04 10:15:30.302119 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept: application/json Jul 04 10:15:30.302119 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept-Encoding: identity Jul 04 10:15:30.302119 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Connection: close Jul 04 10:15:30.302119 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Length: 0 Jul 04 10:15:30.302119 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Type: application/json Jul 04 10:15:30.302119 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Host: 10.222.0.79 Jul 04 10:15:30.302119 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Openstack-System-Scope: None Jul 04 10:15:30.302119 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: User-Agent: python-urllib3/1.26.9 Jul 04 10:15:30.302119 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Auth-Token: gAAAAABiwr2zwHmzmijKq98pFKLcguZP98ADti3cMAhF1uTy0vIxrO1duaoEFlrlOai7iFff4i1zVo_m4armEFiy4IeU_kVpjvsdJG70UU0B0xJXSI5h9_kEswPxaphhknDfuN51clWA0m7nQMu2otWETTI3hFVnfe0aHh-BRwD5ZE1efJxTF7M Jul 04 10:15:30.302119 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Id: None Jul 04 10:15:30.302119 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Name: None Jul 04 10:15:30.302119 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Identity-Status: Confirmed Jul 04 10:15:30.302119 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Is-Admin-Project: True Jul 04 10:15:30.302119 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Id: default Jul 04 10:15:30.302119 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Name: Default Jul 04 10:15:30.302119 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Id: e1ae2bf7ed184f7a99c784aececd1d15 Jul 04 10:15:30.302119 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-957178585 Jul 04 10:15:30.302119 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Role: reader,member Jul 04 10:15:30.302119 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Roles: reader,member Jul 04 10:15:30.303555 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e1ae2bf7ed184f7a99c784aececd1d15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e1ae2bf7ed184f7a99c784aececd1d15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e1ae2bf7ed184f7a99c784aececd1d15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e1ae2bf7ed184f7a99c784aececd1d15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:15:30.303555 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant: tempest-VolumesSnapshotsTestJSON-957178585 Jul 04 10:15:30.303555 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Id: e1ae2bf7ed184f7a99c784aececd1d15 Jul 04 10:15:30.303555 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-957178585 Jul 04 10:15:30.303555 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User: tempest-VolumesSnapshotsTestJSON-957178585-project Jul 04 10:15:30.303555 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Id: default Jul 04 10:15:30.303555 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Name: Default Jul 04 10:15:30.303555 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Id: 044f8d0a53dd435480778bd8bf291b50 Jul 04 10:15:30.303555 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Name: tempest-VolumesSnapshotsTestJSON-957178585-project Jul 04 10:15:30.303555 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: method: Jul 04 10:15:30.303555 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: exception: Volume e02274ca-bfd5-4d77-86b8-539db2fbcfb3 could not be found. Jul 04 10:15:30.303555 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: action_args: {'id': 'e02274ca-bfd5-4d77-86b8-539db2fbcfb3'} Jul 04 10:15:30.303555 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:15:30.304379 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:30.304379 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 10:15:30.304379 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 10:15:30.304379 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 04 10:15:30.304379 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 04 10:15:30.304379 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 04 10:15:30.304379 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 04 10:15:30.304379 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 04 10:15:30.304379 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 04 10:15:30.304379 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 04 10:15:30.304379 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 04 10:15:30.304379 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 10:15:30.304379 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 10:15:30.304379 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 10:15:30.304379 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 10:15:30.304379 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e02274ca-bfd5-4d77-86b8-539db2fbcfb3 could not be found. (HTTP 404) (Request-ID: req-711f60c6-0596-4549-9f2f-367b9cce149c) Jul 04 10:15:30.304379 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:30.304379 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:30.304379 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:30.305587 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:30.305587 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 04 10:15:30.305587 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 04 10:15:30.305587 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 10:15:30.305587 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 10:15:30.305587 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 10:15:30.305587 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 10:15:30.305587 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 10:15:30.305587 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 10:15:30.305587 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 10:15:30.305587 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 10:15:30.305587 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 04 10:15:30.305587 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 04 10:15:30.305587 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 04 10:15:30.305587 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 04 10:15:30.305587 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 04 10:15:30.305587 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 04 10:15:30.305587 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 04 10:15:30.305587 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 04 10:15:30.306858 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 10:15:30.306858 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 10:15:30.306858 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 10:15:30.306858 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 10:15:30.306858 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e02274ca-bfd5-4d77-86b8-539db2fbcfb3 could not be found. Jul 04 10:15:30.306858 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:30.306858 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:30.306858 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:30.306858 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:30.306858 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:30.306858 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:30.306858 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:15:30.306858 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:15:30.306858 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 10:15:30.306858 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 10:15:30.306858 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:15:30.306858 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:15:30.306858 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 04 10:15:30.306858 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:15:30.308050 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e02274ca-bfd5-4d77-86b8-539db2fbcfb3 could not be found. Jul 04 10:15:30.308050 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:30.308050 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:30.308050 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:30.308050 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:30.308050 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:30.308050 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:30.308050 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:15:30.308050 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:15:30.308050 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e02274ca-bfd5-4d77-86b8-539db2fbcfb3 could not be found. Jul 04 10:15:30.308050 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:30.308050 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-c87b1d41-fd1e-4b60-9a12-5fda84654d3c tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] Returning 404 to user: Volume e02274ca-bfd5-4d77-86b8-539db2fbcfb3 could not be found. {{(pid=117866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:15:30.308050 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-c87b1d41-fd1e-4b60-9a12-5fda84654d3c tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/e02274ca-bfd5-4d77-86b8-539db2fbcfb3" status: 404 len: 109 microversion: 2.1 time: 0.036995 Jul 04 10:15:30.308050 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 408/811] 10.222.0.79 () {58 vars in 1247 bytes} [Mon Jul 4 10:15:30 2022] DELETE /compute/v2.1/os-volumes/e02274ca-bfd5-4d77-86b8-539db2fbcfb3 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:15:30.313228 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f0d8413f-b27d-43e8-a14b-299f1a33e5d7 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] Calling method '.version_select at 0x7f2802ec1af0>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:30.341264 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-f0d8413f-b27d-43e8-a14b-299f1a33e5d7 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] HTTP exception thrown: Volume e02274ca-bfd5-4d77-86b8-539db2fbcfb3 could not be found. Jul 04 10:15:30.343792 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f0d8413f-b27d-43e8-a14b-299f1a33e5d7 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] Request method failure captured: Jul 04 10:15:30.343792 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: request: GET /compute/v2.1/os-volumes/e02274ca-bfd5-4d77-86b8-539db2fbcfb3 HTTP/1.1 Jul 04 10:15:30.343792 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept: application/json Jul 04 10:15:30.343792 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept-Encoding: identity Jul 04 10:15:30.343792 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Connection: close Jul 04 10:15:30.343792 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Length: 0 Jul 04 10:15:30.343792 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Type: application/json Jul 04 10:15:30.343792 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Host: 10.222.0.79 Jul 04 10:15:30.343792 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 04 10:15:30.343792 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 04 10:15:30.343792 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Auth-Token: gAAAAABiwr2zwHmzmijKq98pFKLcguZP98ADti3cMAhF1uTy0vIxrO1duaoEFlrlOai7iFff4i1zVo_m4armEFiy4IeU_kVpjvsdJG70UU0B0xJXSI5h9_kEswPxaphhknDfuN51clWA0m7nQMu2otWETTI3hFVnfe0aHh-BRwD5ZE1efJxTF7M Jul 04 10:15:30.343792 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Id: None Jul 04 10:15:30.343792 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Name: None Jul 04 10:15:30.343792 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 04 10:15:30.343792 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 04 10:15:30.343792 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 04 10:15:30.343792 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 04 10:15:30.343792 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Id: e1ae2bf7ed184f7a99c784aececd1d15 Jul 04 10:15:30.343792 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-957178585 Jul 04 10:15:30.343792 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Role: reader,member Jul 04 10:15:30.343792 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Roles: reader,member Jul 04 10:15:30.345381 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e1ae2bf7ed184f7a99c784aececd1d15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e1ae2bf7ed184f7a99c784aececd1d15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e1ae2bf7ed184f7a99c784aececd1d15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e1ae2bf7ed184f7a99c784aececd1d15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:15:30.345381 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant: tempest-VolumesSnapshotsTestJSON-957178585 Jul 04 10:15:30.345381 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Id: e1ae2bf7ed184f7a99c784aececd1d15 Jul 04 10:15:30.345381 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-957178585 Jul 04 10:15:30.345381 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User: tempest-VolumesSnapshotsTestJSON-957178585-project Jul 04 10:15:30.345381 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 04 10:15:30.345381 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 04 10:15:30.345381 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Id: 044f8d0a53dd435480778bd8bf291b50 Jul 04 10:15:30.345381 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Name: tempest-VolumesSnapshotsTestJSON-957178585-project Jul 04 10:15:30.345381 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: method: Jul 04 10:15:30.345381 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: exception: Volume e02274ca-bfd5-4d77-86b8-539db2fbcfb3 could not be found. Jul 04 10:15:30.345381 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: action_args: {'id': 'e02274ca-bfd5-4d77-86b8-539db2fbcfb3'} Jul 04 10:15:30.345381 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:15:30.346217 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:30.346217 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 10:15:30.346217 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 10:15:30.346217 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 10:15:30.346217 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 10:15:30.346217 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 10:15:30.346217 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 10:15:30.346217 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 10:15:30.346217 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 10:15:30.346217 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 10:15:30.346217 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 10:15:30.346217 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 10:15:30.346217 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 10:15:30.346217 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 10:15:30.346217 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 10:15:30.346217 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e02274ca-bfd5-4d77-86b8-539db2fbcfb3 could not be found. (HTTP 404) (Request-ID: req-4fbaf371-9985-42cd-b6dd-16254fe1f343) Jul 04 10:15:30.346217 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:30.346217 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:30.346217 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:30.347312 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:30.347312 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 04 10:15:30.347312 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 04 10:15:30.347312 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 10:15:30.347312 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 10:15:30.347312 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 10:15:30.347312 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 10:15:30.347312 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 10:15:30.347312 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 10:15:30.347312 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 10:15:30.347312 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 10:15:30.347312 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 10:15:30.347312 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 10:15:30.347312 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 10:15:30.347312 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 10:15:30.347312 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 10:15:30.347312 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 10:15:30.347312 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 10:15:30.347312 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 10:15:30.348381 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 10:15:30.348381 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 10:15:30.348381 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 10:15:30.348381 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 10:15:30.348381 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e02274ca-bfd5-4d77-86b8-539db2fbcfb3 could not be found. Jul 04 10:15:30.348381 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:30.348381 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:30.348381 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:30.348381 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:30.348381 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:30.348381 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:30.348381 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:15:30.348381 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:15:30.348381 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 10:15:30.348381 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 10:15:30.348381 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:15:30.348381 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:15:30.348381 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 04 10:15:30.348381 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:15:30.349522 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e02274ca-bfd5-4d77-86b8-539db2fbcfb3 could not be found. Jul 04 10:15:30.349522 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:30.349522 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:30.349522 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:30.349522 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:30.349522 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:30.349522 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:30.349522 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:15:30.349522 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:15:30.349522 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e02274ca-bfd5-4d77-86b8-539db2fbcfb3 could not be found. Jul 04 10:15:30.349522 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:30.349522 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f0d8413f-b27d-43e8-a14b-299f1a33e5d7 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] Returning 404 to user: Volume e02274ca-bfd5-4d77-86b8-539db2fbcfb3 could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:15:30.349522 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f0d8413f-b27d-43e8-a14b-299f1a33e5d7 tempest-VolumesSnapshotsTestJSON-957178585 tempest-VolumesSnapshotsTestJSON-957178585-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/e02274ca-bfd5-4d77-86b8-539db2fbcfb3" status: 404 len: 109 microversion: 2.1 time: 0.036794 Jul 04 10:15:30.349522 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 404/812] 10.222.0.79 () {58 vars in 1244 bytes} [Mon Jul 4 10:15:30 2022] GET /compute/v2.1/os-volumes/e02274ca-bfd5-4d77-86b8-539db2fbcfb3 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:15:30.506156 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-1ee43cb2-7c90-4fa2-9a6e-4345eb2a9fab tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:30.506621 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-1ee43cb2-7c90-4fa2-9a6e-4345eb2a9fab tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:30.512689 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1ee43cb2-7c90-4fa2-9a6e-4345eb2a9fab tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:30.513119 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1ee43cb2-7c90-4fa2-9a6e-4345eb2a9fab tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:30.513903 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1ee43cb2-7c90-4fa2-9a6e-4345eb2a9fab tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:30.514362 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1ee43cb2-7c90-4fa2-9a6e-4345eb2a9fab tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:30.532967 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.wsgi [None req-1ee43cb2-7c90-4fa2-9a6e-4345eb2a9fab tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] HTTP exception thrown: Instance ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 could not be found. Jul 04 10:15:30.534558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-1ee43cb2-7c90-4fa2-9a6e-4345eb2a9fab tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Request method failure captured: Jul 04 10:15:30.534558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: request: DELETE /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 HTTP/1.1 Jul 04 10:15:30.534558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept: application/json Jul 04 10:15:30.534558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept-Encoding: identity Jul 04 10:15:30.534558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Connection: close Jul 04 10:15:30.534558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Length: 0 Jul 04 10:15:30.534558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Type: application/json Jul 04 10:15:30.534558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Host: 10.222.0.79 Jul 04 10:15:30.534558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Openstack-System-Scope: None Jul 04 10:15:30.534558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: User-Agent: python-urllib3/1.26.9 Jul 04 10:15:30.534558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Auth-Token: gAAAAABiwrwsRjPFfauJ0cIzMInBcEwtVng9DptjB6OPKNfVygqH0eCVAApJP28q3UyvJOOyf4svKw5vjRunfIOFo_QaQJeMPe34oQOw61-tXGDN64BxOzNizWTxQ-yvVdFgXtg5_SGTWj_hasuWYs2yuFpQLMypxGx5O68Q-1MWK1ukE3GPXaM Jul 04 10:15:30.534558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Id: None Jul 04 10:15:30.534558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Name: None Jul 04 10:15:30.534558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Identity-Status: Confirmed Jul 04 10:15:30.534558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Is-Admin-Project: True Jul 04 10:15:30.534558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Openstack-Nova-Api-Version: 2.20 Jul 04 10:15:30.534558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Id: default Jul 04 10:15:30.534558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Name: Default Jul 04 10:15:30.534558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Id: b852926ec18f4dc695da5ec1c5582f48 Jul 04 10:15:30.534558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1729716423 Jul 04 10:15:30.534558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Role: reader,member Jul 04 10:15:30.534558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Roles: reader,member Jul 04 10:15:30.536313 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b852926ec18f4dc695da5ec1c5582f48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b852926ec18f4dc695da5ec1c5582f48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b852926ec18f4dc695da5ec1c5582f48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b852926ec18f4dc695da5ec1c5582f48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:15:30.536313 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1729716423 Jul 04 10:15:30.536313 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Id: b852926ec18f4dc695da5ec1c5582f48 Jul 04 10:15:30.536313 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1729716423 Jul 04 10:15:30.536313 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User: tempest-AttachVolumeShelveTestJSON-1729716423-project Jul 04 10:15:30.536313 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Id: default Jul 04 10:15:30.536313 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Name: Default Jul 04 10:15:30.536313 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Id: 1c05b9b08df0437f9b0abb167d17aa56 Jul 04 10:15:30.536313 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1729716423-project Jul 04 10:15:30.536313 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: method: > Jul 04 10:15:30.536313 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: exception: Instance ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 could not be found. Jul 04 10:15:30.536313 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: action_args: {'id': 'ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2'} Jul 04 10:15:30.540183 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:15:30.540183 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:30.540183 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:15:30.540183 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:15:30.540183 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:15:30.540183 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:15:30.540183 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:15:30.540183 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:15:30.540183 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:15:30.540183 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:15:30.540183 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 could not be found. Jul 04 10:15:30.540183 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:30.540183 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:30.540183 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:30.540183 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:30.540183 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:30.540183 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:30.540183 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:15:30.540183 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:15:30.540183 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:15:30.541789 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:15:30.541789 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 10:15:30.541789 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 10:15:30.541789 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 10:15:30.541789 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 10:15:30.541789 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:15:30.541789 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:15:30.541789 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:15:30.541789 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:15:30.541789 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 could not be found. Jul 04 10:15:30.541789 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:30.541789 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:30.541789 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:30.541789 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:30.541789 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:30.541789 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:30.541789 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:15:30.541789 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:15:30.541789 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 could not be found. Jul 04 10:15:30.541789 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:30.543305 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-1ee43cb2-7c90-4fa2-9a6e-4345eb2a9fab tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Returning 404 to user: Instance ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 could not be found. {{(pid=117866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:15:30.543305 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-1ee43cb2-7c90-4fa2-9a6e-4345eb2a9fab tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 404 len: 111 microversion: 2.20 time: 0.034560 Jul 04 10:15:30.543305 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 409/813] 10.222.0.79 () {60 vars in 1279 bytes} [Mon Jul 4 10:15:30 2022] DELETE /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 04 10:15:30.544844 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-37e5fbaa-01af-43b3-a044-b09740159312 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:30.545409 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-37e5fbaa-01af-43b3-a044-b09740159312 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] [instance: ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:30.552813 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-37e5fbaa-01af-43b3-a044-b09740159312 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:30.553245 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-37e5fbaa-01af-43b3-a044-b09740159312 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:30.554055 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-37e5fbaa-01af-43b3-a044-b09740159312 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:30.554495 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-37e5fbaa-01af-43b3-a044-b09740159312 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:30.568698 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-37e5fbaa-01af-43b3-a044-b09740159312 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] HTTP exception thrown: Instance ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 could not be found. Jul 04 10:15:30.570366 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-37e5fbaa-01af-43b3-a044-b09740159312 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Request method failure captured: Jul 04 10:15:30.570366 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: request: GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 HTTP/1.1 Jul 04 10:15:30.570366 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept: application/json Jul 04 10:15:30.570366 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept-Encoding: identity Jul 04 10:15:30.570366 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Connection: close Jul 04 10:15:30.570366 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Length: 0 Jul 04 10:15:30.570366 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Type: application/json Jul 04 10:15:30.570366 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Host: 10.222.0.79 Jul 04 10:15:30.570366 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 04 10:15:30.570366 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 04 10:15:30.570366 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Auth-Token: gAAAAABiwrwsRjPFfauJ0cIzMInBcEwtVng9DptjB6OPKNfVygqH0eCVAApJP28q3UyvJOOyf4svKw5vjRunfIOFo_QaQJeMPe34oQOw61-tXGDN64BxOzNizWTxQ-yvVdFgXtg5_SGTWj_hasuWYs2yuFpQLMypxGx5O68Q-1MWK1ukE3GPXaM Jul 04 10:15:30.570366 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Id: None Jul 04 10:15:30.570366 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Name: None Jul 04 10:15:30.570366 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 04 10:15:30.570366 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 04 10:15:30.570366 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Openstack-Nova-Api-Version: 2.20 Jul 04 10:15:30.570366 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 04 10:15:30.570366 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 04 10:15:30.570366 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Id: b852926ec18f4dc695da5ec1c5582f48 Jul 04 10:15:30.570366 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1729716423 Jul 04 10:15:30.570366 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Role: reader,member Jul 04 10:15:30.570366 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Roles: reader,member Jul 04 10:15:30.572000 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b852926ec18f4dc695da5ec1c5582f48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b852926ec18f4dc695da5ec1c5582f48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b852926ec18f4dc695da5ec1c5582f48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b852926ec18f4dc695da5ec1c5582f48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:15:30.572000 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1729716423 Jul 04 10:15:30.572000 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Id: b852926ec18f4dc695da5ec1c5582f48 Jul 04 10:15:30.572000 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1729716423 Jul 04 10:15:30.572000 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User: tempest-AttachVolumeShelveTestJSON-1729716423-project Jul 04 10:15:30.572000 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 04 10:15:30.572000 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 04 10:15:30.572000 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Id: 1c05b9b08df0437f9b0abb167d17aa56 Jul 04 10:15:30.572000 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1729716423-project Jul 04 10:15:30.572000 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: method: > Jul 04 10:15:30.572000 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: exception: Instance ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 could not be found. Jul 04 10:15:30.572000 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: action_args: {'id': 'ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2'} Jul 04 10:15:30.576461 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:15:30.576461 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:30.576461 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:15:30.576461 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:15:30.576461 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:15:30.576461 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:15:30.576461 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:15:30.576461 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:15:30.576461 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:15:30.576461 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:15:30.576461 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 could not be found. Jul 04 10:15:30.576461 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:30.576461 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:30.576461 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:30.576461 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:30.576461 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:30.576461 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:30.576461 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:15:30.576461 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:15:30.576461 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:15:30.577745 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:15:30.577745 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 10:15:30.577745 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 10:15:30.577745 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:15:30.577745 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:15:30.577745 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:15:30.577745 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:15:30.577745 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 could not be found. Jul 04 10:15:30.577745 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:30.577745 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:30.577745 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:30.577745 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:30.577745 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:30.577745 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:30.577745 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:15:30.577745 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:15:30.577745 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 could not be found. Jul 04 10:15:30.577745 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:30.579424 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-37e5fbaa-01af-43b3-a044-b09740159312 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] Returning 404 to user: Instance ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:15:30.579424 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-37e5fbaa-01af-43b3-a044-b09740159312 tempest-AttachVolumeShelveTestJSON-1729716423 tempest-AttachVolumeShelveTestJSON-1729716423-project] 10.222.0.79 "GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2" status: 404 len: 111 microversion: 2.20 time: 0.030747 Jul 04 10:15:30.579424 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 405/814] 10.222.0.79 () {60 vars in 1276 bytes} [Mon Jul 4 10:15:30 2022] GET /compute/v2.1/servers/ea79bd27-fdf0-4c8e-a439-b3c1d7c524d2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 04 10:15:32.019705 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-67074b9e-bd6d-49d5-9685-18c4c52bb957 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:32.020344 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-67074b9e-bd6d-49d5-9685-18c4c52bb957 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: 82a2a58e-dfab-406a-a775-4a992d898eac] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:32.027252 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-67074b9e-bd6d-49d5-9685-18c4c52bb957 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:32.027874 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-67074b9e-bd6d-49d5-9685-18c4c52bb957 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:32.029036 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-67074b9e-bd6d-49d5-9685-18c4c52bb957 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:32.029530 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-67074b9e-bd6d-49d5-9685-18c4c52bb957 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:32.182787 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.objects.instance [None req-67074b9e-bd6d-49d5-9685-18c4c52bb957 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lazy-loading 'services' on Instance uuid 82a2a58e-dfab-406a-a775-4a992d898eac {{(pid=117866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 10:15:32.310643 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-67074b9e-bd6d-49d5-9685-18c4c52bb957 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "DELETE /compute/v2.1/servers/82a2a58e-dfab-406a-a775-4a992d898eac/os-volume_attachments/3d3336bd-c1de-4bdb-87ed-7c2dc8642c69" status: 202 len: 0 microversion: 2.1 time: 0.295434 Jul 04 10:15:32.312293 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 410/815] 10.222.0.79 () {58 vars in 1415 bytes} [Mon Jul 4 10:15:32 2022] DELETE /compute/v2.1/servers/82a2a58e-dfab-406a-a775-4a992d898eac/os-volume_attachments/3d3336bd-c1de-4bdb-87ed-7c2dc8642c69 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 10:15:33.438366 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-ad2a167b-e9f4-4937-a68b-0c61e0ba58fe tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:33.444028 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-ad2a167b-e9f4-4937-a68b-0c61e0ba58fe tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: 82a2a58e-dfab-406a-a775-4a992d898eac] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:33.446120 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ad2a167b-e9f4-4937-a68b-0c61e0ba58fe tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:33.446547 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ad2a167b-e9f4-4937-a68b-0c61e0ba58fe tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:33.447500 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ad2a167b-e9f4-4937-a68b-0c61e0ba58fe tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:33.448092 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ad2a167b-e9f4-4937-a68b-0c61e0ba58fe tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:33.476463 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-ad2a167b-e9f4-4937-a68b-0c61e0ba58fe tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: 82a2a58e-dfab-406a-a775-4a992d898eac] Going to try to terminate instance {{(pid=117865) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 10:15:33.564841 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-ad2a167b-e9f4-4937-a68b-0c61e0ba58fe tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "DELETE /compute/v2.1/servers/82a2a58e-dfab-406a-a775-4a992d898eac" status: 204 len: 0 microversion: 2.1 time: 0.130069 Jul 04 10:15:33.566234 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 406/816] 10.222.0.79 () {58 vars in 1238 bytes} [Mon Jul 4 10:15:33 2022] DELETE /compute/v2.1/servers/82a2a58e-dfab-406a-a775-4a992d898eac => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 10:15:33.576050 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-e9b0e504-d559-4d6e-86fd-a580fc274dc1 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:33.576767 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-e9b0e504-d559-4d6e-86fd-a580fc274dc1 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: 82a2a58e-dfab-406a-a775-4a992d898eac] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:33.587580 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e9b0e504-d559-4d6e-86fd-a580fc274dc1 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:33.587580 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e9b0e504-d559-4d6e-86fd-a580fc274dc1 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:33.587580 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e9b0e504-d559-4d6e-86fd-a580fc274dc1 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:33.587580 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e9b0e504-d559-4d6e-86fd-a580fc274dc1 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:33.783534 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-e9b0e504-d559-4d6e-86fd-a580fc274dc1 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495a8406c184164982d136edc351cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02795b95a9b84564999233883b763e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:33.796214 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-e9b0e504-d559-4d6e-86fd-a580fc274dc1 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "GET /compute/v2.1/servers/82a2a58e-dfab-406a-a775-4a992d898eac" status: 200 len: 1513 microversion: 2.1 time: 0.224856 Jul 04 10:15:33.797974 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 411/817] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:15:33 2022] GET /compute/v2.1/servers/82a2a58e-dfab-406a-a775-4a992d898eac => generated 1513 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:15:34.821536 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-cd697ff7-be70-49cc-a09d-5fc0a2631936 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:34.822270 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-cd697ff7-be70-49cc-a09d-5fc0a2631936 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: 82a2a58e-dfab-406a-a775-4a992d898eac] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:34.831435 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cd697ff7-be70-49cc-a09d-5fc0a2631936 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:34.832538 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cd697ff7-be70-49cc-a09d-5fc0a2631936 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:34.833358 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cd697ff7-be70-49cc-a09d-5fc0a2631936 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:34.833846 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cd697ff7-be70-49cc-a09d-5fc0a2631936 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:35.037601 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-cd697ff7-be70-49cc-a09d-5fc0a2631936 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495a8406c184164982d136edc351cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02795b95a9b84564999233883b763e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:35.045878 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-cd697ff7-be70-49cc-a09d-5fc0a2631936 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "GET /compute/v2.1/servers/82a2a58e-dfab-406a-a775-4a992d898eac" status: 200 len: 1513 microversion: 2.1 time: 0.229339 Jul 04 10:15:35.046717 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 407/818] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:15:34 2022] GET /compute/v2.1/servers/82a2a58e-dfab-406a-a775-4a992d898eac => generated 1513 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:15:36.063061 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-d157b669-4a71-4400-834a-95ca06c7799d tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:36.063730 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-d157b669-4a71-4400-834a-95ca06c7799d tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: 82a2a58e-dfab-406a-a775-4a992d898eac] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:36.070940 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d157b669-4a71-4400-834a-95ca06c7799d tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:36.071497 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d157b669-4a71-4400-834a-95ca06c7799d tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:36.072275 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d157b669-4a71-4400-834a-95ca06c7799d tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:36.072746 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d157b669-4a71-4400-834a-95ca06c7799d tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:36.126126 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-29e856a6-ec84-41e1-a751-57b064a26366 req-109cfa51-81eb-4e67-ba71-6a9c272f3561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82a2a58e-dfab-406a-a775-4a992d898eac", "name": "network-vif-deleted", "tag": "10abad8c-4bdd-4d14-9eee-86bb78bb17ad"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:15:36.142912 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-29e856a6-ec84-41e1-a751-57b064a26366 req-109cfa51-81eb-4e67-ba71-6a9c272f3561 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:36.143697 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-29e856a6-ec84-41e1-a751-57b064a26366 req-109cfa51-81eb-4e67-ba71-6a9c272f3561 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:36.156822 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-29e856a6-ec84-41e1-a751-57b064a26366 req-109cfa51-81eb-4e67-ba71-6a9c272f3561 service nova] Creating event network-vif-deleted:10abad8c-4bdd-4d14-9eee-86bb78bb17ad for instance 82a2a58e-dfab-406a-a775-4a992d898eac on hv-cinder-84841 Jul 04 10:15:36.157108 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-d157b669-4a71-4400-834a-95ca06c7799d tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495a8406c184164982d136edc351cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02795b95a9b84564999233883b763e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:36.163900 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-29e856a6-ec84-41e1-a751-57b064a26366 req-109cfa51-81eb-4e67-ba71-6a9c272f3561 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041487 Jul 04 10:15:36.164904 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 408/819] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 10:15:36.176650 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-d157b669-4a71-4400-834a-95ca06c7799d tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "GET /compute/v2.1/servers/82a2a58e-dfab-406a-a775-4a992d898eac" status: 200 len: 1471 microversion: 2.1 time: 0.116190 Jul 04 10:15:36.178239 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 412/820] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:15:36 2022] GET /compute/v2.1/servers/82a2a58e-dfab-406a-a775-4a992d898eac => generated 1471 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:15:36.351772 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-0f07e0eb-35e5-40b2-8dc3-c7b12d600bdb tempest-VolumesGetTestJSON-1890751724 tempest-VolumesGetTestJSON-1890751724-project] Action: 'create', calling method: .version_select at 0x7f2802ed4430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-356293107", "metadata": {"Type": "work"}}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:15:36.721704 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-0f07e0eb-35e5-40b2-8dc3-c7b12d600bdb tempest-VolumesGetTestJSON-1890751724 tempest-VolumesGetTestJSON-1890751724-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.490369 Jul 04 10:15:36.722363 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 409/821] 10.222.0.79 () {60 vars in 1155 bytes} [Mon Jul 4 10:15:36 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 492 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 04 10:15:36.734127 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-74ad9ab4-5b07-4c7b-a244-212b373e5e1c tempest-VolumesGetTestJSON-1890751724 tempest-VolumesGetTestJSON-1890751724-project] Calling method '.version_select at 0x7f2802fb8dc0>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:36.788986 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-74ad9ab4-5b07-4c7b-a244-212b373e5e1c tempest-VolumesGetTestJSON-1890751724 tempest-VolumesGetTestJSON-1890751724-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/790ed30a-e1c2-4889-b2bf-5e11fa815815" status: 200 len: 352 microversion: 2.1 time: 0.059044 Jul 04 10:15:36.789566 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 413/822] 10.222.0.79 () {58 vars in 1244 bytes} [Mon Jul 4 10:15:36 2022] GET /compute/v2.1/os-volumes/790ed30a-e1c2-4889-b2bf-5e11fa815815 => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:15:37.194694 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-db1f7268-27d5-485f-b650-03a0ef33b8c2 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:37.195370 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-db1f7268-27d5-485f-b650-03a0ef33b8c2 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: 82a2a58e-dfab-406a-a775-4a992d898eac] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:37.202581 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-db1f7268-27d5-485f-b650-03a0ef33b8c2 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:37.203045 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-db1f7268-27d5-485f-b650-03a0ef33b8c2 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:37.203795 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-db1f7268-27d5-485f-b650-03a0ef33b8c2 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:37.204222 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-db1f7268-27d5-485f-b650-03a0ef33b8c2 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:37.218429 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-db1f7268-27d5-485f-b650-03a0ef33b8c2 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] HTTP exception thrown: Instance 82a2a58e-dfab-406a-a775-4a992d898eac could not be found. Jul 04 10:15:37.220095 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-db1f7268-27d5-485f-b650-03a0ef33b8c2 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Request method failure captured: Jul 04 10:15:37.220095 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: request: GET /compute/v2.1/servers/82a2a58e-dfab-406a-a775-4a992d898eac HTTP/1.1 Jul 04 10:15:37.220095 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept: application/json Jul 04 10:15:37.220095 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept-Encoding: identity Jul 04 10:15:37.220095 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Connection: close Jul 04 10:15:37.220095 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Length: 0 Jul 04 10:15:37.220095 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Type: application/json Jul 04 10:15:37.220095 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Host: 10.222.0.79 Jul 04 10:15:37.220095 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 04 10:15:37.220095 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 04 10:15:37.220095 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Auth-Token: gAAAAABiwr2P9ZN0gzNrFdyUNTHGNwXrAIKsgIIvjus-99mnxsnQkw8brbeW-BwdVQBsFSMzlHLCt7n6rRGQ1XsCMDjMNtHqPHyg2W36lUZ3bG84anDyj7xht-Dvfl434IWNAzLAI5jV2OTl3OJ1euQIQqpTAtOEy5t9YA-MId8Vl2KaS6O-97A Jul 04 10:15:37.220095 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Id: None Jul 04 10:15:37.220095 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Name: None Jul 04 10:15:37.220095 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 04 10:15:37.220095 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 04 10:15:37.220095 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 04 10:15:37.220095 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 04 10:15:37.220095 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Id: 02795b95a9b84564999233883b763e4f Jul 04 10:15:37.220095 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Name: tempest-VolumesSnapshotTestJSON-520468413 Jul 04 10:15:37.220095 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Role: reader,member Jul 04 10:15:37.220095 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Roles: reader,member Jul 04 10:15:37.222178 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/02795b95a9b84564999233883b763e4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_02795b95a9b84564999233883b763e4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/02795b95a9b84564999233883b763e4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/02795b95a9b84564999233883b763e4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:15:37.222178 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant: tempest-VolumesSnapshotTestJSON-520468413 Jul 04 10:15:37.222178 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Id: 02795b95a9b84564999233883b763e4f Jul 04 10:15:37.222178 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-520468413 Jul 04 10:15:37.222178 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User: tempest-VolumesSnapshotTestJSON-520468413-project Jul 04 10:15:37.222178 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 04 10:15:37.222178 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 04 10:15:37.222178 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Id: 2495a8406c184164982d136edc351cfd Jul 04 10:15:37.222178 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Name: tempest-VolumesSnapshotTestJSON-520468413-project Jul 04 10:15:37.222178 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: method: > Jul 04 10:15:37.222178 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: exception: Instance 82a2a58e-dfab-406a-a775-4a992d898eac could not be found. Jul 04 10:15:37.222178 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: action_args: {'id': '82a2a58e-dfab-406a-a775-4a992d898eac'} Jul 04 10:15:37.223242 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:15:37.223242 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:37.223242 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:15:37.223242 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:15:37.223242 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:15:37.223242 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:15:37.223242 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:15:37.223242 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:15:37.223242 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:15:37.223242 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:15:37.223242 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82a2a58e-dfab-406a-a775-4a992d898eac could not be found. Jul 04 10:15:37.223242 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:37.223242 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:37.223242 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:37.223242 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:37.223242 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:37.223242 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:37.223242 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:15:37.223242 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:15:37.223242 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:15:37.224643 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:15:37.224643 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 10:15:37.224643 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 10:15:37.224643 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:15:37.224643 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:15:37.224643 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:15:37.224643 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:15:37.224643 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82a2a58e-dfab-406a-a775-4a992d898eac could not be found. Jul 04 10:15:37.224643 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:37.224643 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:37.224643 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:37.224643 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:37.224643 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:37.224643 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:37.224643 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:15:37.224643 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:15:37.224643 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82a2a58e-dfab-406a-a775-4a992d898eac could not be found. Jul 04 10:15:37.224643 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:15:37.226887 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-db1f7268-27d5-485f-b650-03a0ef33b8c2 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Returning 404 to user: Instance 82a2a58e-dfab-406a-a775-4a992d898eac could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:15:37.226887 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-db1f7268-27d5-485f-b650-03a0ef33b8c2 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "GET /compute/v2.1/servers/82a2a58e-dfab-406a-a775-4a992d898eac" status: 404 len: 111 microversion: 2.1 time: 0.031161 Jul 04 10:15:37.226887 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 410/823] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:15:37 2022] GET /compute/v2.1/servers/82a2a58e-dfab-406a-a775-4a992d898eac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:15:37.804512 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-848401d6-aea6-43e5-819d-f5ec26b820ad tempest-VolumesGetTestJSON-1890751724 tempest-VolumesGetTestJSON-1890751724-project] Calling method '.version_select at 0x7f2802edf8b0>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:37.859913 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-848401d6-aea6-43e5-819d-f5ec26b820ad tempest-VolumesGetTestJSON-1890751724 tempest-VolumesGetTestJSON-1890751724-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/790ed30a-e1c2-4889-b2bf-5e11fa815815" status: 200 len: 353 microversion: 2.1 time: 0.060405 Jul 04 10:15:37.860599 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 414/824] 10.222.0.79 () {58 vars in 1244 bytes} [Mon Jul 4 10:15:37 2022] GET /compute/v2.1/os-volumes/790ed30a-e1c2-4889-b2bf-5e11fa815815 => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:15:37.871648 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2e3de87c-de6d-4dfd-91f6-de73df8221b6 tempest-VolumesGetTestJSON-1890751724 tempest-VolumesGetTestJSON-1890751724-project] Calling method '.version_select at 0x7f2802f2ff70>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:37.919903 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-2e3de87c-de6d-4dfd-91f6-de73df8221b6 tempest-VolumesGetTestJSON-1890751724 tempest-VolumesGetTestJSON-1890751724-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/790ed30a-e1c2-4889-b2bf-5e11fa815815" status: 200 len: 353 microversion: 2.1 time: 0.051993 Jul 04 10:15:37.920459 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 411/825] 10.222.0.79 () {58 vars in 1244 bytes} [Mon Jul 4 10:15:37 2022] GET /compute/v2.1/os-volumes/790ed30a-e1c2-4889-b2bf-5e11fa815815 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:15:37.936783 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-8b5946cb-0599-4759-baea-a5f864c72bf3 tempest-VolumesGetTestJSON-1890751724 tempest-VolumesGetTestJSON-1890751724-project] Calling method '.version_select at 0x7f2802fca430>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:38.007200 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-8b5946cb-0599-4759-baea-a5f864c72bf3 tempest-VolumesGetTestJSON-1890751724 tempest-VolumesGetTestJSON-1890751724-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/790ed30a-e1c2-4889-b2bf-5e11fa815815" status: 202 len: 0 microversion: 2.1 time: 0.074301 Jul 04 10:15:38.007924 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 415/826] 10.222.0.79 () {58 vars in 1247 bytes} [Mon Jul 4 10:15:37 2022] DELETE /compute/v2.1/os-volumes/790ed30a-e1c2-4889-b2bf-5e11fa815815 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 10:15:38.016601 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5cd898fb-3a19-4025-a1ad-fb3843d4d487 tempest-VolumesGetTestJSON-1890751724 tempest-VolumesGetTestJSON-1890751724-project] Calling method '.version_select at 0x7f2802e3f670>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:38.069543 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-5cd898fb-3a19-4025-a1ad-fb3843d4d487 tempest-VolumesGetTestJSON-1890751724 tempest-VolumesGetTestJSON-1890751724-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/790ed30a-e1c2-4889-b2bf-5e11fa815815" status: 200 len: 352 microversion: 2.1 time: 0.057360 Jul 04 10:15:38.070266 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 412/827] 10.222.0.79 () {58 vars in 1244 bytes} [Mon Jul 4 10:15:38 2022] GET /compute/v2.1/os-volumes/790ed30a-e1c2-4889-b2bf-5e11fa815815 => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 10:15:39.087546 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-11ac5ac1-6122-43de-9964-2d9fa8252e90 tempest-VolumesGetTestJSON-1890751724 tempest-VolumesGetTestJSON-1890751724-project] Calling method '.version_select at 0x7f2802fb84c0>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:39.147516 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-11ac5ac1-6122-43de-9964-2d9fa8252e90 tempest-VolumesGetTestJSON-1890751724 tempest-VolumesGetTestJSON-1890751724-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/790ed30a-e1c2-4889-b2bf-5e11fa815815" status: 200 len: 352 microversion: 2.1 time: 0.067401 Jul 04 10:15:39.148211 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 416/828] 10.222.0.79 () {58 vars in 1244 bytes} [Mon Jul 4 10:15:39 2022] GET /compute/v2.1/os-volumes/790ed30a-e1c2-4889-b2bf-5e11fa815815 => generated 352 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:15:40.160773 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-ae28b257-a1f6-4f2e-8878-d6d873f45a07 tempest-VolumesGetTestJSON-1890751724 tempest-VolumesGetTestJSON-1890751724-project] Calling method '.version_select at 0x7f2802eb2280>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:40.210614 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-ae28b257-a1f6-4f2e-8878-d6d873f45a07 tempest-VolumesGetTestJSON-1890751724 tempest-VolumesGetTestJSON-1890751724-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/790ed30a-e1c2-4889-b2bf-5e11fa815815" status: 200 len: 352 microversion: 2.1 time: 0.054509 Jul 04 10:15:40.211175 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 413/829] 10.222.0.79 () {58 vars in 1244 bytes} [Mon Jul 4 10:15:40 2022] GET /compute/v2.1/os-volumes/790ed30a-e1c2-4889-b2bf-5e11fa815815 => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:15:41.224809 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-75f65b81-7d01-4a84-b4b5-eac4889285f3 tempest-VolumesGetTestJSON-1890751724 tempest-VolumesGetTestJSON-1890751724-project] Calling method '.version_select at 0x7f2802fcac10>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:41.252108 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.wsgi [None req-75f65b81-7d01-4a84-b4b5-eac4889285f3 tempest-VolumesGetTestJSON-1890751724 tempest-VolumesGetTestJSON-1890751724-project] HTTP exception thrown: Volume 790ed30a-e1c2-4889-b2bf-5e11fa815815 could not be found. Jul 04 10:15:41.254701 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-75f65b81-7d01-4a84-b4b5-eac4889285f3 tempest-VolumesGetTestJSON-1890751724 tempest-VolumesGetTestJSON-1890751724-project] Request method failure captured: Jul 04 10:15:41.254701 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: request: GET /compute/v2.1/os-volumes/790ed30a-e1c2-4889-b2bf-5e11fa815815 HTTP/1.1 Jul 04 10:15:41.254701 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept: application/json Jul 04 10:15:41.254701 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept-Encoding: identity Jul 04 10:15:41.254701 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Connection: close Jul 04 10:15:41.254701 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Length: 0 Jul 04 10:15:41.254701 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Type: application/json Jul 04 10:15:41.254701 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Host: 10.222.0.79 Jul 04 10:15:41.254701 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Openstack-System-Scope: None Jul 04 10:15:41.254701 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: User-Agent: python-urllib3/1.26.9 Jul 04 10:15:41.254701 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Auth-Token: gAAAAABiwr3IYjbB06rw-jJCH63MXBzVQGzlS8IQzHDW0uvUQZ4_6x9geWN3WSI3WqovvCRxQ5EShf8hacDvltkBf09GNEiwwsyDM3q644QoSiflrzuYKQOKJgVTHqAjYNNT-3kJId6WWKtnORJql33wjutxGsiHDqkdoMauMDyklt_KCCvwIqI Jul 04 10:15:41.254701 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Id: None Jul 04 10:15:41.254701 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Name: None Jul 04 10:15:41.254701 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Identity-Status: Confirmed Jul 04 10:15:41.254701 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Is-Admin-Project: True Jul 04 10:15:41.254701 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Id: default Jul 04 10:15:41.254701 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Name: Default Jul 04 10:15:41.254701 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Id: f25d559b4b6b41219ad36c5a3095ac28 Jul 04 10:15:41.254701 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Name: tempest-VolumesGetTestJSON-1890751724 Jul 04 10:15:41.254701 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Role: reader,member Jul 04 10:15:41.254701 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Roles: reader,member Jul 04 10:15:41.256242 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f25d559b4b6b41219ad36c5a3095ac28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f25d559b4b6b41219ad36c5a3095ac28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f25d559b4b6b41219ad36c5a3095ac28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f25d559b4b6b41219ad36c5a3095ac28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:15:41.256242 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant: tempest-VolumesGetTestJSON-1890751724 Jul 04 10:15:41.256242 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Id: f25d559b4b6b41219ad36c5a3095ac28 Jul 04 10:15:41.256242 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Name: tempest-VolumesGetTestJSON-1890751724 Jul 04 10:15:41.256242 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User: tempest-VolumesGetTestJSON-1890751724-project Jul 04 10:15:41.256242 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Id: default Jul 04 10:15:41.256242 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Name: Default Jul 04 10:15:41.256242 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Id: 1bada738d94b4424b76f8637a6aab66a Jul 04 10:15:41.256242 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Name: tempest-VolumesGetTestJSON-1890751724-project Jul 04 10:15:41.256242 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: method: Jul 04 10:15:41.256242 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: exception: Volume 790ed30a-e1c2-4889-b2bf-5e11fa815815 could not be found. Jul 04 10:15:41.256242 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: action_args: {'id': '790ed30a-e1c2-4889-b2bf-5e11fa815815'} Jul 04 10:15:41.256242 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:15:41.257035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:41.257035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 10:15:41.257035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 10:15:41.257035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 10:15:41.257035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 10:15:41.257035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 10:15:41.257035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 10:15:41.257035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 10:15:41.257035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 10:15:41.257035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 10:15:41.257035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 10:15:41.257035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 10:15:41.257035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 10:15:41.257035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 10:15:41.257035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 10:15:41.257035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 790ed30a-e1c2-4889-b2bf-5e11fa815815 could not be found. (HTTP 404) (Request-ID: req-40f15f82-20d1-4eab-8f5d-174f837b6fc8) Jul 04 10:15:41.257035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:41.257035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:41.257035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:41.258196 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:41.258196 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 04 10:15:41.258196 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 04 10:15:41.258196 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 10:15:41.258196 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 10:15:41.258196 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 10:15:41.258196 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 10:15:41.258196 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 10:15:41.258196 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 10:15:41.258196 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 10:15:41.258196 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 10:15:41.258196 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 10:15:41.258196 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 10:15:41.258196 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 10:15:41.258196 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 10:15:41.258196 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 10:15:41.258196 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 10:15:41.258196 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 10:15:41.258196 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 10:15:41.259353 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 10:15:41.259353 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 10:15:41.259353 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 10:15:41.259353 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 10:15:41.259353 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 790ed30a-e1c2-4889-b2bf-5e11fa815815 could not be found. Jul 04 10:15:41.259353 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:41.259353 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:41.259353 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:41.259353 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:41.259353 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:41.259353 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:41.259353 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:15:41.259353 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:15:41.259353 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 10:15:41.259353 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 10:15:41.259353 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:15:41.259353 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:15:41.259353 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 04 10:15:41.259353 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:15:41.260541 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 790ed30a-e1c2-4889-b2bf-5e11fa815815 could not be found. Jul 04 10:15:41.260541 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:41.260541 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:15:41.260541 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:41.260541 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:15:41.260541 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:15:41.260541 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:15:41.260541 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:15:41.260541 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:15:41.260541 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 790ed30a-e1c2-4889-b2bf-5e11fa815815 could not be found. Jul 04 10:15:41.260541 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:15:41.260541 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-75f65b81-7d01-4a84-b4b5-eac4889285f3 tempest-VolumesGetTestJSON-1890751724 tempest-VolumesGetTestJSON-1890751724-project] Returning 404 to user: Volume 790ed30a-e1c2-4889-b2bf-5e11fa815815 could not be found. {{(pid=117866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:15:41.260541 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-75f65b81-7d01-4a84-b4b5-eac4889285f3 tempest-VolumesGetTestJSON-1890751724 tempest-VolumesGetTestJSON-1890751724-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/790ed30a-e1c2-4889-b2bf-5e11fa815815" status: 404 len: 109 microversion: 2.1 time: 0.036546 Jul 04 10:15:41.260541 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 417/830] 10.222.0.79 () {58 vars in 1244 bytes} [Mon Jul 4 10:15:41 2022] GET /compute/v2.1/os-volumes/790ed30a-e1c2-4889-b2bf-5e11fa815815 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:15:45.177674 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-45e99bfd-7465-47a8-8033-d81ceb38ce46 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1971664655", "imageRef": "80bd29b0-b77c-4611-be31-69ca559a2d2a", "flavorRef": "452", "networks": [{"uuid": "7cfa67a6-e002-4bb8-b37c-80e0c41eb386"}]}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:15:45.237307 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.network.neutron [None req-45e99bfd-7465-47a8-8033-d81ceb38ce46 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] validate_networks() for [('7cfa67a6-e002-4bb8-b37c-80e0c41eb386', None, None, None, None, None)] {{(pid=117865) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 10:15:45.596334 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-45e99bfd-7465-47a8-8033-d81ceb38ce46 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Flavor limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 10:15:45.596746 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-45e99bfd-7465-47a8-8033-d81ceb38ce46 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Image limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 10:15:45.597256 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-45e99bfd-7465-47a8-8033-d81ceb38ce46 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Flavor pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 10:15:45.597658 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-45e99bfd-7465-47a8-8033-d81ceb38ce46 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Image pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 10:15:45.598019 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-45e99bfd-7465-47a8-8033-d81ceb38ce46 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 10:15:45.606925 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-45e99bfd-7465-47a8-8033-d81ceb38ce46 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:45.607376 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-45e99bfd-7465-47a8-8033-d81ceb38ce46 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:45.608140 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-45e99bfd-7465-47a8-8033-d81ceb38ce46 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:45.608565 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-45e99bfd-7465-47a8-8033-d81ceb38ce46 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:45.625868 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-45e99bfd-7465-47a8-8033-d81ceb38ce46 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Getting quotas for project 02795b95a9b84564999233883b763e4f. Resources: {'cores', 'ram', 'instances'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 10:15:45.630244 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-45e99bfd-7465-47a8-8033-d81ceb38ce46 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Getting quotas for user 2495a8406c184164982d136edc351cfd and project 02795b95a9b84564999233883b763e4f. Resources: {'cores', 'ram', 'instances'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 10:15:45.641941 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-45e99bfd-7465-47a8-8033-d81ceb38ce46 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Going to run 1 instances... {{(pid=117865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 10:15:45.644284 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-45e99bfd-7465-47a8-8033-d81ceb38ce46 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: d2a1784f-42f6-4008-8876-e94fe9c5b2e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80bd29b0-b77c-4611-be31-69ca559a2d2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 10:15:45.691196 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-45e99bfd-7465-47a8-8033-d81ceb38ce46 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.518259 Jul 04 10:15:45.691845 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 414/831] 10.222.0.79 () {60 vars in 1146 bytes} [Mon Jul 4 10:15:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 10:15:45.702522 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-86b85edf-05ed-4021-9a2e-1a95a739d187 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:45.703367 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-86b85edf-05ed-4021-9a2e-1a95a739d187 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: d2a1784f-42f6-4008-8876-e94fe9c5b2e5] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:45.777523 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-86b85edf-05ed-4021-9a2e-1a95a739d187 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495a8406c184164982d136edc351cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02795b95a9b84564999233883b763e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:45.788714 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-86b85edf-05ed-4021-9a2e-1a95a739d187 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5" status: 200 len: 1219 microversion: 2.1 time: 0.089809 Jul 04 10:15:45.789261 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 418/832] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:15:45 2022] GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:15:46.806285 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-020075aa-ebfc-4a8e-b91b-bacf2722ac0d tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:46.806890 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-020075aa-ebfc-4a8e-b91b-bacf2722ac0d tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: d2a1784f-42f6-4008-8876-e94fe9c5b2e5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:46.813287 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-020075aa-ebfc-4a8e-b91b-bacf2722ac0d tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:46.813756 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-020075aa-ebfc-4a8e-b91b-bacf2722ac0d tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:46.814508 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-020075aa-ebfc-4a8e-b91b-bacf2722ac0d tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:46.814969 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-020075aa-ebfc-4a8e-b91b-bacf2722ac0d tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:46.881783 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-020075aa-ebfc-4a8e-b91b-bacf2722ac0d tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495a8406c184164982d136edc351cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02795b95a9b84564999233883b763e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:46.889245 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-020075aa-ebfc-4a8e-b91b-bacf2722ac0d tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5" status: 200 len: 1271 microversion: 2.1 time: 0.087420 Jul 04 10:15:46.891449 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 415/833] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:15:46 2022] GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5 => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:15:47.907038 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-b17fc875-4e12-4159-8f3c-96afbaad43bc tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:47.908269 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-b17fc875-4e12-4159-8f3c-96afbaad43bc tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: d2a1784f-42f6-4008-8876-e94fe9c5b2e5] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:47.911689 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell1:SELECT=56,nova_cell1:INSERT=1 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:15:47.919912 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b17fc875-4e12-4159-8f3c-96afbaad43bc tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:47.919912 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b17fc875-4e12-4159-8f3c-96afbaad43bc tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:47.919912 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b17fc875-4e12-4159-8f3c-96afbaad43bc tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:47.919912 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b17fc875-4e12-4159-8f3c-96afbaad43bc tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:47.987403 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-b17fc875-4e12-4159-8f3c-96afbaad43bc tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495a8406c184164982d136edc351cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02795b95a9b84564999233883b763e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:47.995291 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-b17fc875-4e12-4159-8f3c-96afbaad43bc tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5" status: 200 len: 1271 microversion: 2.1 time: 0.092605 Jul 04 10:15:47.996053 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 419/834] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:15:47 2022] GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5 => generated 1271 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:15:49.012400 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-c4f8582d-21f5-4237-8c0e-f38589c95b7f tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:49.013007 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-c4f8582d-21f5-4237-8c0e-f38589c95b7f tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: d2a1784f-42f6-4008-8876-e94fe9c5b2e5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:49.015525 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:15:49.022309 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c4f8582d-21f5-4237-8c0e-f38589c95b7f tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:49.022309 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c4f8582d-21f5-4237-8c0e-f38589c95b7f tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:49.022756 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c4f8582d-21f5-4237-8c0e-f38589c95b7f tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:49.026057 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c4f8582d-21f5-4237-8c0e-f38589c95b7f tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:49.026748 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=48,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:15:49.091662 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-c4f8582d-21f5-4237-8c0e-f38589c95b7f tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495a8406c184164982d136edc351cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02795b95a9b84564999233883b763e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:49.099067 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-c4f8582d-21f5-4237-8c0e-f38589c95b7f tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5" status: 200 len: 1271 microversion: 2.1 time: 0.090657 Jul 04 10:15:49.099682 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 416/835] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:15:49 2022] GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5 => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:15:50.116137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-e179abad-c0a5-42ef-81d7-5d5bdb4b7cbd tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:50.116749 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-e179abad-c0a5-42ef-81d7-5d5bdb4b7cbd tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: d2a1784f-42f6-4008-8876-e94fe9c5b2e5] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:50.119155 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:15:50.125035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e179abad-c0a5-42ef-81d7-5d5bdb4b7cbd tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:50.125480 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e179abad-c0a5-42ef-81d7-5d5bdb4b7cbd tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:50.126286 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e179abad-c0a5-42ef-81d7-5d5bdb4b7cbd tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:50.127000 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e179abad-c0a5-42ef-81d7-5d5bdb4b7cbd tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:50.264075 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-e179abad-c0a5-42ef-81d7-5d5bdb4b7cbd tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495a8406c184164982d136edc351cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02795b95a9b84564999233883b763e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:50.271921 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-e179abad-c0a5-42ef-81d7-5d5bdb4b7cbd tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5" status: 200 len: 1319 microversion: 2.1 time: 0.159942 Jul 04 10:15:50.272494 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 420/836] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:15:50 2022] GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:15:51.288707 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b0ad1f11-0fd4-46e6-8db9-9fcc530ca2a6 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:51.289371 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-b0ad1f11-0fd4-46e6-8db9-9fcc530ca2a6 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: d2a1784f-42f6-4008-8876-e94fe9c5b2e5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:51.296085 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b0ad1f11-0fd4-46e6-8db9-9fcc530ca2a6 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:51.296534 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b0ad1f11-0fd4-46e6-8db9-9fcc530ca2a6 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:51.297270 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b0ad1f11-0fd4-46e6-8db9-9fcc530ca2a6 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:51.297783 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b0ad1f11-0fd4-46e6-8db9-9fcc530ca2a6 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:51.516666 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-b0ad1f11-0fd4-46e6-8db9-9fcc530ca2a6 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495a8406c184164982d136edc351cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02795b95a9b84564999233883b763e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:51.524315 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-b0ad1f11-0fd4-46e6-8db9-9fcc530ca2a6 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5" status: 200 len: 1319 microversion: 2.1 time: 0.239548 Jul 04 10:15:51.524891 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 417/837] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:15:51 2022] GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5 => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:15:51.826742 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-0f9c08e1-bd8c-440b-9544-f79e65d2e61a req-9c654f06-29ee-4b94-820a-ab070efeef7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2a1784f-42f6-4008-8876-e94fe9c5b2e5", "tag": "3e85a0da-42ed-45c8-9f74-14b797540c24"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:15:51.836429 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-0f9c08e1-bd8c-440b-9544-f79e65d2e61a req-9c654f06-29ee-4b94-820a-ab070efeef7a service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:51.837023 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-0f9c08e1-bd8c-440b-9544-f79e65d2e61a req-9c654f06-29ee-4b94-820a-ab070efeef7a service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:51.850611 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-0f9c08e1-bd8c-440b-9544-f79e65d2e61a req-9c654f06-29ee-4b94-820a-ab070efeef7a service nova] Creating event network-changed:3e85a0da-42ed-45c8-9f74-14b797540c24 for instance d2a1784f-42f6-4008-8876-e94fe9c5b2e5 on hv-cinder-84841 Jul 04 10:15:51.855636 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-0f9c08e1-bd8c-440b-9544-f79e65d2e61a req-9c654f06-29ee-4b94-820a-ab070efeef7a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032839 Jul 04 10:15:51.856335 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 421/838] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 10:15:52.545280 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5d051e44-c0ee-4175-be6e-92dba33ca223 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:52.547286 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-5d051e44-c0ee-4175-be6e-92dba33ca223 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: d2a1784f-42f6-4008-8876-e94fe9c5b2e5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:52.557767 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5d051e44-c0ee-4175-be6e-92dba33ca223 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:52.559507 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5d051e44-c0ee-4175-be6e-92dba33ca223 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:52.560759 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5d051e44-c0ee-4175-be6e-92dba33ca223 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:52.561435 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5d051e44-c0ee-4175-be6e-92dba33ca223 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:52.808566 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-5d051e44-c0ee-4175-be6e-92dba33ca223 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495a8406c184164982d136edc351cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02795b95a9b84564999233883b763e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:52.817407 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-5d051e44-c0ee-4175-be6e-92dba33ca223 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5" status: 200 len: 1319 microversion: 2.1 time: 0.280554 Jul 04 10:15:52.818432 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 418/839] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:15:52 2022] GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5 => generated 1319 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:15:53.835495 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-59c0b827-c8ff-4b01-8dd3-00d087b17329 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:53.836306 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-59c0b827-c8ff-4b01-8dd3-00d087b17329 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: d2a1784f-42f6-4008-8876-e94fe9c5b2e5] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:53.843597 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-59c0b827-c8ff-4b01-8dd3-00d087b17329 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:53.844068 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-59c0b827-c8ff-4b01-8dd3-00d087b17329 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:53.844826 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-59c0b827-c8ff-4b01-8dd3-00d087b17329 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:53.845255 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-59c0b827-c8ff-4b01-8dd3-00d087b17329 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:53.988061 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-59c0b827-c8ff-4b01-8dd3-00d087b17329 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495a8406c184164982d136edc351cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02795b95a9b84564999233883b763e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:53.996532 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-59c0b827-c8ff-4b01-8dd3-00d087b17329 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5" status: 200 len: 1319 microversion: 2.1 time: 0.165410 Jul 04 10:15:53.997113 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 422/840] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:15:53 2022] GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:15:55.014026 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-cd371d8c-0413-4bf7-8395-4ad627c6e6c4 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:55.014635 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-cd371d8c-0413-4bf7-8395-4ad627c6e6c4 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: d2a1784f-42f6-4008-8876-e94fe9c5b2e5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:55.022065 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cd371d8c-0413-4bf7-8395-4ad627c6e6c4 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:55.022514 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cd371d8c-0413-4bf7-8395-4ad627c6e6c4 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:55.023299 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cd371d8c-0413-4bf7-8395-4ad627c6e6c4 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:55.023720 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cd371d8c-0413-4bf7-8395-4ad627c6e6c4 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:55.172806 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-cd371d8c-0413-4bf7-8395-4ad627c6e6c4 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495a8406c184164982d136edc351cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02795b95a9b84564999233883b763e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:55.180997 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-cd371d8c-0413-4bf7-8395-4ad627c6e6c4 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5" status: 200 len: 1319 microversion: 2.1 time: 0.171010 Jul 04 10:15:55.181584 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 419/841] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:15:55 2022] GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:15:56.198286 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-1ab6a308-02bc-4120-8f17-bd6c12d4dde8 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:56.198900 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-1ab6a308-02bc-4120-8f17-bd6c12d4dde8 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: d2a1784f-42f6-4008-8876-e94fe9c5b2e5] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:56.202078 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell0:SELECT=2 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:15:56.205917 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1ab6a308-02bc-4120-8f17-bd6c12d4dde8 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:56.206203 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1ab6a308-02bc-4120-8f17-bd6c12d4dde8 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:56.207028 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1ab6a308-02bc-4120-8f17-bd6c12d4dde8 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:56.207750 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1ab6a308-02bc-4120-8f17-bd6c12d4dde8 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:56.376350 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-1ab6a308-02bc-4120-8f17-bd6c12d4dde8 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495a8406c184164982d136edc351cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02795b95a9b84564999233883b763e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:56.384251 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-1ab6a308-02bc-4120-8f17-bd6c12d4dde8 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5" status: 200 len: 1319 microversion: 2.1 time: 0.189829 Jul 04 10:15:56.384813 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 423/842] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:15:56 2022] GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:15:57.400835 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-c560307b-4180-4a04-94eb-8e945ad448f2 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:57.401445 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-c560307b-4180-4a04-94eb-8e945ad448f2 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: d2a1784f-42f6-4008-8876-e94fe9c5b2e5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:57.403300 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:15:57.404006 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=6 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:15:57.410744 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c560307b-4180-4a04-94eb-8e945ad448f2 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:57.411185 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c560307b-4180-4a04-94eb-8e945ad448f2 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:57.411969 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c560307b-4180-4a04-94eb-8e945ad448f2 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:57.412389 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c560307b-4180-4a04-94eb-8e945ad448f2 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:57.547930 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-c560307b-4180-4a04-94eb-8e945ad448f2 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495a8406c184164982d136edc351cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02795b95a9b84564999233883b763e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:57.557815 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-c560307b-4180-4a04-94eb-8e945ad448f2 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5" status: 200 len: 1319 microversion: 2.1 time: 0.160630 Jul 04 10:15:57.558666 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 420/843] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:15:57 2022] GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:15:58.192261 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-b65ea5ea-a59e-4126-8db2-4d947248f57d req-747462aa-a0f7-40ff-a5fd-2f8e62ecf7ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2a1784f-42f6-4008-8876-e94fe9c5b2e5", "name": "network-vif-plugged", "status": "completed", "tag": "3e85a0da-42ed-45c8-9f74-14b797540c24"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:15:58.201014 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-b65ea5ea-a59e-4126-8db2-4d947248f57d req-747462aa-a0f7-40ff-a5fd-2f8e62ecf7ac service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:58.201507 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-b65ea5ea-a59e-4126-8db2-4d947248f57d req-747462aa-a0f7-40ff-a5fd-2f8e62ecf7ac service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:58.215251 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-b65ea5ea-a59e-4126-8db2-4d947248f57d req-747462aa-a0f7-40ff-a5fd-2f8e62ecf7ac service nova] Creating event network-vif-plugged:3e85a0da-42ed-45c8-9f74-14b797540c24 for instance d2a1784f-42f6-4008-8876-e94fe9c5b2e5 on hv-cinder-84841 Jul 04 10:15:58.220488 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-b65ea5ea-a59e-4126-8db2-4d947248f57d req-747462aa-a0f7-40ff-a5fd-2f8e62ecf7ac service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032099 Jul 04 10:15:58.221120 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 424/844] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:15:58.577198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-96cb3ad1-4566-4905-8dc0-a8095e71bc16 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:58.577933 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-96cb3ad1-4566-4905-8dc0-a8095e71bc16 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: d2a1784f-42f6-4008-8876-e94fe9c5b2e5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:58.586439 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-96cb3ad1-4566-4905-8dc0-a8095e71bc16 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:58.587145 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-96cb3ad1-4566-4905-8dc0-a8095e71bc16 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:58.588283 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-96cb3ad1-4566-4905-8dc0-a8095e71bc16 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:58.588903 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-96cb3ad1-4566-4905-8dc0-a8095e71bc16 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:58.908435 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-96cb3ad1-4566-4905-8dc0-a8095e71bc16 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495a8406c184164982d136edc351cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02795b95a9b84564999233883b763e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:15:58.916638 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-96cb3ad1-4566-4905-8dc0-a8095e71bc16 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5" status: 200 len: 1319 microversion: 2.1 time: 0.343962 Jul 04 10:15:58.917197 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 421/845] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:15:58 2022] GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5 => generated 1319 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:15:59.934465 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-ba031ee2-dfdd-44bb-b4df-b53ea3f83246 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:15:59.936847 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-ba031ee2-dfdd-44bb-b4df-b53ea3f83246 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: d2a1784f-42f6-4008-8876-e94fe9c5b2e5] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:15:59.944854 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ba031ee2-dfdd-44bb-b4df-b53ea3f83246 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:59.945457 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ba031ee2-dfdd-44bb-b4df-b53ea3f83246 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:15:59.946314 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ba031ee2-dfdd-44bb-b4df-b53ea3f83246 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:15:59.946978 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ba031ee2-dfdd-44bb-b4df-b53ea3f83246 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:00.123381 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-ba031ee2-dfdd-44bb-b4df-b53ea3f83246 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495a8406c184164982d136edc351cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02795b95a9b84564999233883b763e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:00.131642 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-ba031ee2-dfdd-44bb-b4df-b53ea3f83246 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5" status: 200 len: 1508 microversion: 2.1 time: 0.201884 Jul 04 10:16:00.132219 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 425/846] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:15:59 2022] GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5 => generated 1508 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:16:00.151515 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-938ce5cf-31d0-4eb6-8b32-c832c35b43a0 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23ede016-935e-4424-a9ee-f6415d6016db", "device": "/dev/sdb"}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:16:00.152726 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-938ce5cf-31d0-4eb6-8b32-c832c35b43a0 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: d2a1784f-42f6-4008-8876-e94fe9c5b2e5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:00.160051 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-938ce5cf-31d0-4eb6-8b32-c832c35b43a0 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:00.160810 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-938ce5cf-31d0-4eb6-8b32-c832c35b43a0 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:00.161794 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-938ce5cf-31d0-4eb6-8b32-c832c35b43a0 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:00.162439 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-938ce5cf-31d0-4eb6-8b32-c832c35b43a0 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:00.458139 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-938ce5cf-31d0-4eb6-8b32-c832c35b43a0 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "POST /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310372 Jul 04 10:16:00.460302 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 422/847] 10.222.0.79 () {60 vars in 1322 bytes} [Mon Jul 4 10:16:00 2022] POST /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:16:04.410235 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-9f3f2205-3506-4eab-9c7a-bd928127e3f9 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1084008701", "imageRef": "80bd29b0-b77c-4611-be31-69ca559a2d2a", "flavorRef": "452"}} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:16:04.465855 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.network.neutron [None req-9f3f2205-3506-4eab-9c7a-bd928127e3f9 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] validate_networks() for None {{(pid=117866) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 10:16:04.748682 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-9f3f2205-3506-4eab-9c7a-bd928127e3f9 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Flavor limits 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 10:16:04.749224 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-9f3f2205-3506-4eab-9c7a-bd928127e3f9 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Image limits 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 10:16:04.749787 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-9f3f2205-3506-4eab-9c7a-bd928127e3f9 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Flavor pref 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 10:16:04.750277 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-9f3f2205-3506-4eab-9c7a-bd928127e3f9 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Image pref 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 10:16:04.750736 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-9f3f2205-3506-4eab-9c7a-bd928127e3f9 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 10:16:04.760064 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9f3f2205-3506-4eab-9c7a-bd928127e3f9 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:04.760568 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9f3f2205-3506-4eab-9c7a-bd928127e3f9 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:04.761412 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9f3f2205-3506-4eab-9c7a-bd928127e3f9 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:04.762012 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9f3f2205-3506-4eab-9c7a-bd928127e3f9 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:04.780449 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.quota [None req-9f3f2205-3506-4eab-9c7a-bd928127e3f9 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Getting quotas for project 10baff2f6e0a421d8050f69d97e6c7c1. Resources: {'cores', 'ram', 'instances'} {{(pid=117866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 10:16:04.784256 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.quota [None req-9f3f2205-3506-4eab-9c7a-bd928127e3f9 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Getting quotas for user 8f80d61cfbe949a7a55d565de30b63ba and project 10baff2f6e0a421d8050f69d97e6c7c1. Resources: {'cores', 'ram', 'instances'} {{(pid=117866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 10:16:04.795237 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-9f3f2205-3506-4eab-9c7a-bd928127e3f9 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Going to run 1 instances... {{(pid=117866) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 10:16:04.797746 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-9f3f2205-3506-4eab-9c7a-bd928127e3f9 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] [instance: ffd80713-357e-41a4-8c07-866bb74d13a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80bd29b0-b77c-4611-be31-69ca559a2d2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 10:16:04.845569 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-9f3f2205-3506-4eab-9c7a-bd928127e3f9 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.439255 Jul 04 10:16:04.846249 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 426/848] 10.222.0.79 () {60 vars in 1146 bytes} [Mon Jul 4 10:16:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 10:16:04.857859 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-323ae80d-46a3-4407-8968-8383ff4cee9a tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:04.858547 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-323ae80d-46a3-4407-8968-8383ff4cee9a tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] [instance: ffd80713-357e-41a4-8c07-866bb74d13a1] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:04.930249 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-323ae80d-46a3-4407-8968-8383ff4cee9a tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f80d61cfbe949a7a55d565de30b63ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10baff2f6e0a421d8050f69d97e6c7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:04.938310 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-323ae80d-46a3-4407-8968-8383ff4cee9a tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] 10.222.0.79 "GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1" status: 200 len: 1215 microversion: 2.1 time: 0.085059 Jul 04 10:16:04.939077 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 423/849] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:04 2022] GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1 => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:05.958283 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-7fb7494f-8fb3-456b-8f77-4e591fb7d908 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:05.959065 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-7fb7494f-8fb3-456b-8f77-4e591fb7d908 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] [instance: ffd80713-357e-41a4-8c07-866bb74d13a1] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:05.967803 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7fb7494f-8fb3-456b-8f77-4e591fb7d908 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:05.968249 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7fb7494f-8fb3-456b-8f77-4e591fb7d908 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:05.969016 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7fb7494f-8fb3-456b-8f77-4e591fb7d908 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:05.969449 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7fb7494f-8fb3-456b-8f77-4e591fb7d908 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:06.038928 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-7fb7494f-8fb3-456b-8f77-4e591fb7d908 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f80d61cfbe949a7a55d565de30b63ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10baff2f6e0a421d8050f69d97e6c7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:06.047177 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-7fb7494f-8fb3-456b-8f77-4e591fb7d908 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] 10.222.0.79 "GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1" status: 200 len: 1285 microversion: 2.1 time: 0.094310 Jul 04 10:16:06.047689 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 427/850] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:05 2022] GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1 => generated 1285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:07.069968 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-40d6c3d4-0d66-4332-87f9-5917ac484c67 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:07.069968 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-40d6c3d4-0d66-4332-87f9-5917ac484c67 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] [instance: ffd80713-357e-41a4-8c07-866bb74d13a1] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:07.077487 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-40d6c3d4-0d66-4332-87f9-5917ac484c67 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:07.077922 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-40d6c3d4-0d66-4332-87f9-5917ac484c67 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:07.078696 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-40d6c3d4-0d66-4332-87f9-5917ac484c67 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:07.079129 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-40d6c3d4-0d66-4332-87f9-5917ac484c67 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:07.271176 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-40d6c3d4-0d66-4332-87f9-5917ac484c67 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f80d61cfbe949a7a55d565de30b63ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10baff2f6e0a421d8050f69d97e6c7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:07.278928 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-40d6c3d4-0d66-4332-87f9-5917ac484c67 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] 10.222.0.79 "GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1" status: 200 len: 1315 microversion: 2.1 time: 0.217986 Jul 04 10:16:07.279490 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 424/851] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:07 2022] GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:07.821639 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-df9f2c1a-1923-4920-b083-a62e4e4d85b1 req-dc1ed755-b609-49ad-b945-a9a663a054b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffd80713-357e-41a4-8c07-866bb74d13a1", "tag": "e98bf53e-6975-4a7e-8a41-581d26361119"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:16:07.831850 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-df9f2c1a-1923-4920-b083-a62e4e4d85b1 req-dc1ed755-b609-49ad-b945-a9a663a054b8 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:07.832283 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-df9f2c1a-1923-4920-b083-a62e4e4d85b1 req-dc1ed755-b609-49ad-b945-a9a663a054b8 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:07.844607 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-df9f2c1a-1923-4920-b083-a62e4e4d85b1 req-dc1ed755-b609-49ad-b945-a9a663a054b8 service nova] Creating event network-changed:e98bf53e-6975-4a7e-8a41-581d26361119 for instance ffd80713-357e-41a4-8c07-866bb74d13a1 on hv-cinder-84841 Jul 04 10:16:07.849710 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-df9f2c1a-1923-4920-b083-a62e4e4d85b1 req-dc1ed755-b609-49ad-b945-a9a663a054b8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032730 Jul 04 10:16:07.850320 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 428/852] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:16:08.300487 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-3878aa4e-e4cd-49c4-b221-6ad7383b1d44 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:08.301404 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-3878aa4e-e4cd-49c4-b221-6ad7383b1d44 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] [instance: ffd80713-357e-41a4-8c07-866bb74d13a1] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:08.311318 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3878aa4e-e4cd-49c4-b221-6ad7383b1d44 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:08.311765 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3878aa4e-e4cd-49c4-b221-6ad7383b1d44 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:08.312551 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3878aa4e-e4cd-49c4-b221-6ad7383b1d44 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:08.312976 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3878aa4e-e4cd-49c4-b221-6ad7383b1d44 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:08.458999 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-3878aa4e-e4cd-49c4-b221-6ad7383b1d44 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f80d61cfbe949a7a55d565de30b63ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10baff2f6e0a421d8050f69d97e6c7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:08.467734 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-3878aa4e-e4cd-49c4-b221-6ad7383b1d44 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] 10.222.0.79 "GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1" status: 200 len: 1315 microversion: 2.1 time: 0.173853 Jul 04 10:16:08.468306 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 425/853] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:08 2022] GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:09.491719 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-c86d50af-fac3-4c72-af6e-58f0d40a691f tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:09.492731 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-c86d50af-fac3-4c72-af6e-58f0d40a691f tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] [instance: ffd80713-357e-41a4-8c07-866bb74d13a1] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:09.501328 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c86d50af-fac3-4c72-af6e-58f0d40a691f tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:09.501796 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c86d50af-fac3-4c72-af6e-58f0d40a691f tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:09.502575 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c86d50af-fac3-4c72-af6e-58f0d40a691f tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:09.503002 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-c86d50af-fac3-4c72-af6e-58f0d40a691f tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:09.640949 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-c86d50af-fac3-4c72-af6e-58f0d40a691f tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f80d61cfbe949a7a55d565de30b63ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10baff2f6e0a421d8050f69d97e6c7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:09.651365 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-c86d50af-fac3-4c72-af6e-58f0d40a691f tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] 10.222.0.79 "GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1" status: 200 len: 1315 microversion: 2.1 time: 0.167580 Jul 04 10:16:09.652058 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 429/854] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:09 2022] GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:10.668566 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-cf187787-142e-4863-b28c-76ef6d06a65a tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:10.669187 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-cf187787-142e-4863-b28c-76ef6d06a65a tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] [instance: ffd80713-357e-41a4-8c07-866bb74d13a1] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:10.676484 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cf187787-142e-4863-b28c-76ef6d06a65a tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:10.676792 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cf187787-142e-4863-b28c-76ef6d06a65a tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:10.677586 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cf187787-142e-4863-b28c-76ef6d06a65a tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:10.678042 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cf187787-142e-4863-b28c-76ef6d06a65a tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:10.879556 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-cf187787-142e-4863-b28c-76ef6d06a65a tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f80d61cfbe949a7a55d565de30b63ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10baff2f6e0a421d8050f69d97e6c7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:10.887643 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-cf187787-142e-4863-b28c-76ef6d06a65a tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] 10.222.0.79 "GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1" status: 200 len: 1315 microversion: 2.1 time: 0.222987 Jul 04 10:16:10.888944 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 426/855] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:10 2022] GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:11.904485 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-3f07badc-2592-48f4-9ec3-cbef5f8b56cb tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:11.905087 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-3f07badc-2592-48f4-9ec3-cbef5f8b56cb tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] [instance: ffd80713-357e-41a4-8c07-866bb74d13a1] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:11.912110 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3f07badc-2592-48f4-9ec3-cbef5f8b56cb tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:11.912559 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3f07badc-2592-48f4-9ec3-cbef5f8b56cb tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:11.913330 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3f07badc-2592-48f4-9ec3-cbef5f8b56cb tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:11.913803 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3f07badc-2592-48f4-9ec3-cbef5f8b56cb tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:12.051592 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-3f07badc-2592-48f4-9ec3-cbef5f8b56cb tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f80d61cfbe949a7a55d565de30b63ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10baff2f6e0a421d8050f69d97e6c7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:12.059718 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-3f07badc-2592-48f4-9ec3-cbef5f8b56cb tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] 10.222.0.79 "GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1" status: 200 len: 1315 microversion: 2.1 time: 0.159179 Jul 04 10:16:12.060461 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 430/856] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:11 2022] GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:13.079933 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-6b42517d-637e-4d7f-adfd-108c4096559e tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:13.080767 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-6b42517d-637e-4d7f-adfd-108c4096559e tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] [instance: ffd80713-357e-41a4-8c07-866bb74d13a1] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:13.090697 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6b42517d-637e-4d7f-adfd-108c4096559e tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:13.091324 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6b42517d-637e-4d7f-adfd-108c4096559e tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:13.092385 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6b42517d-637e-4d7f-adfd-108c4096559e tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:13.092989 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6b42517d-637e-4d7f-adfd-108c4096559e tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:13.234491 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-6b42517d-637e-4d7f-adfd-108c4096559e tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f80d61cfbe949a7a55d565de30b63ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10baff2f6e0a421d8050f69d97e6c7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:13.241993 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-6b42517d-637e-4d7f-adfd-108c4096559e tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] 10.222.0.79 "GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1" status: 200 len: 1315 microversion: 2.1 time: 0.167911 Jul 04 10:16:13.242657 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 427/857] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:13 2022] GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:14.262007 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-0e9187d6-13a8-47b7-b621-551067e3a4e5 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:14.262878 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-0e9187d6-13a8-47b7-b621-551067e3a4e5 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] [instance: ffd80713-357e-41a4-8c07-866bb74d13a1] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:14.271217 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0e9187d6-13a8-47b7-b621-551067e3a4e5 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:14.271671 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0e9187d6-13a8-47b7-b621-551067e3a4e5 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:14.272431 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0e9187d6-13a8-47b7-b621-551067e3a4e5 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:14.272865 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0e9187d6-13a8-47b7-b621-551067e3a4e5 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:14.411145 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-0e9187d6-13a8-47b7-b621-551067e3a4e5 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f80d61cfbe949a7a55d565de30b63ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10baff2f6e0a421d8050f69d97e6c7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:14.418886 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-0e9187d6-13a8-47b7-b621-551067e3a4e5 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] 10.222.0.79 "GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1" status: 200 len: 1315 microversion: 2.1 time: 0.162839 Jul 04 10:16:14.419438 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 431/858] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:14 2022] GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:15.440019 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-dc797755-6c60-4887-b9ab-15ff0b760acb tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:15.440605 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-dc797755-6c60-4887-b9ab-15ff0b760acb tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] [instance: ffd80713-357e-41a4-8c07-866bb74d13a1] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:15.443086 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:16:15.449302 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-dc797755-6c60-4887-b9ab-15ff0b760acb tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:15.449777 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-dc797755-6c60-4887-b9ab-15ff0b760acb tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:15.450540 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-dc797755-6c60-4887-b9ab-15ff0b760acb tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:15.450975 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-dc797755-6c60-4887-b9ab-15ff0b760acb tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:15.587413 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-dc797755-6c60-4887-b9ab-15ff0b760acb tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f80d61cfbe949a7a55d565de30b63ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10baff2f6e0a421d8050f69d97e6c7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:15.595393 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-dc797755-6c60-4887-b9ab-15ff0b760acb tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] 10.222.0.79 "GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1" status: 200 len: 1315 microversion: 2.1 time: 0.162035 Jul 04 10:16:15.595990 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 428/859] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:15 2022] GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:16.612617 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-f6e8f6c1-1e5a-4caf-8b8c-cc830ad3eaba tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:16.613206 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-f6e8f6c1-1e5a-4caf-8b8c-cc830ad3eaba tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] [instance: ffd80713-357e-41a4-8c07-866bb74d13a1] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:16.615453 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell0:SELECT=2 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:16:16.616097 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell0:SELECT=6 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:16:16.622527 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f6e8f6c1-1e5a-4caf-8b8c-cc830ad3eaba tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:16.622978 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f6e8f6c1-1e5a-4caf-8b8c-cc830ad3eaba tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:16.623713 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f6e8f6c1-1e5a-4caf-8b8c-cc830ad3eaba tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:16.624135 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f6e8f6c1-1e5a-4caf-8b8c-cc830ad3eaba tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:16.761590 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-f6e8f6c1-1e5a-4caf-8b8c-cc830ad3eaba tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f80d61cfbe949a7a55d565de30b63ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10baff2f6e0a421d8050f69d97e6c7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:16.769825 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-f6e8f6c1-1e5a-4caf-8b8c-cc830ad3eaba tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] 10.222.0.79 "GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1" status: 200 len: 1315 microversion: 2.1 time: 0.161098 Jul 04 10:16:16.770392 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 432/860] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:16 2022] GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:17.786628 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-6e09fc1f-ae72-4cef-bf4f-2317c35db4d0 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:17.787211 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-6e09fc1f-ae72-4cef-bf4f-2317c35db4d0 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] [instance: ffd80713-357e-41a4-8c07-866bb74d13a1] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:17.794453 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6e09fc1f-ae72-4cef-bf4f-2317c35db4d0 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:17.794905 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6e09fc1f-ae72-4cef-bf4f-2317c35db4d0 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:17.795844 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6e09fc1f-ae72-4cef-bf4f-2317c35db4d0 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:17.796271 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6e09fc1f-ae72-4cef-bf4f-2317c35db4d0 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:17.939234 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-6e09fc1f-ae72-4cef-bf4f-2317c35db4d0 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f80d61cfbe949a7a55d565de30b63ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10baff2f6e0a421d8050f69d97e6c7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:17.946734 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-6e09fc1f-ae72-4cef-bf4f-2317c35db4d0 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] 10.222.0.79 "GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1" status: 200 len: 1315 microversion: 2.1 time: 0.164418 Jul 04 10:16:17.947598 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 429/861] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:17 2022] GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:18.964131 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-e3768be0-b941-41e7-b129-a495e355d7f1 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:18.964735 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-e3768be0-b941-41e7-b129-a495e355d7f1 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] [instance: ffd80713-357e-41a4-8c07-866bb74d13a1] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:18.971379 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e3768be0-b941-41e7-b129-a495e355d7f1 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:18.971816 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e3768be0-b941-41e7-b129-a495e355d7f1 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:18.972651 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e3768be0-b941-41e7-b129-a495e355d7f1 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:18.973070 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e3768be0-b941-41e7-b129-a495e355d7f1 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:18.975635 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell1:SELECT=69 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:16:19.111825 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-e3768be0-b941-41e7-b129-a495e355d7f1 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f80d61cfbe949a7a55d565de30b63ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10baff2f6e0a421d8050f69d97e6c7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:19.122277 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-e3768be0-b941-41e7-b129-a495e355d7f1 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] 10.222.0.79 "GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1" status: 200 len: 1315 microversion: 2.1 time: 0.162375 Jul 04 10:16:19.122851 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 433/862] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:18 2022] GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:20.140148 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-ffb4c10a-7dec-4fab-8b7c-815d7b640dc5 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:20.140752 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-ffb4c10a-7dec-4fab-8b7c-815d7b640dc5 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] [instance: ffd80713-357e-41a4-8c07-866bb74d13a1] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:20.143205 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=30 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:16:20.149388 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ffb4c10a-7dec-4fab-8b7c-815d7b640dc5 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:20.149865 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ffb4c10a-7dec-4fab-8b7c-815d7b640dc5 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:20.150629 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ffb4c10a-7dec-4fab-8b7c-815d7b640dc5 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:20.151080 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ffb4c10a-7dec-4fab-8b7c-815d7b640dc5 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:20.153969 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:16:20.285246 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-ffb4c10a-7dec-4fab-8b7c-815d7b640dc5 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f80d61cfbe949a7a55d565de30b63ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10baff2f6e0a421d8050f69d97e6c7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:20.293247 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-ffb4c10a-7dec-4fab-8b7c-815d7b640dc5 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] 10.222.0.79 "GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1" status: 200 len: 1315 microversion: 2.1 time: 0.157073 Jul 04 10:16:20.293834 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 430/863] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:20 2022] GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:21.314794 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-a552d1ec-0fce-4c65-bc97-5f9234fe5719 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:21.315760 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-a552d1ec-0fce-4c65-bc97-5f9234fe5719 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] [instance: ffd80713-357e-41a4-8c07-866bb74d13a1] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:21.319593 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:16:21.325143 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a552d1ec-0fce-4c65-bc97-5f9234fe5719 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:21.325586 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a552d1ec-0fce-4c65-bc97-5f9234fe5719 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:21.326416 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a552d1ec-0fce-4c65-bc97-5f9234fe5719 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:21.326847 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-a552d1ec-0fce-4c65-bc97-5f9234fe5719 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:21.459396 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-a552d1ec-0fce-4c65-bc97-5f9234fe5719 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f80d61cfbe949a7a55d565de30b63ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10baff2f6e0a421d8050f69d97e6c7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:21.471272 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-a552d1ec-0fce-4c65-bc97-5f9234fe5719 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] 10.222.0.79 "GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1" status: 200 len: 1315 microversion: 2.1 time: 0.162678 Jul 04 10:16:21.472010 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 434/864] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:21 2022] GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:22.492226 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f3e28292-16ed-4b40-bc3e-341fbecc2a4a tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:22.492963 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f3e28292-16ed-4b40-bc3e-341fbecc2a4a tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] [instance: ffd80713-357e-41a4-8c07-866bb74d13a1] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:22.501052 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f3e28292-16ed-4b40-bc3e-341fbecc2a4a tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:22.501539 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f3e28292-16ed-4b40-bc3e-341fbecc2a4a tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:22.502353 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f3e28292-16ed-4b40-bc3e-341fbecc2a4a tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:22.502968 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f3e28292-16ed-4b40-bc3e-341fbecc2a4a tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:22.655813 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-f3e28292-16ed-4b40-bc3e-341fbecc2a4a tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f80d61cfbe949a7a55d565de30b63ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10baff2f6e0a421d8050f69d97e6c7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:22.664187 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f3e28292-16ed-4b40-bc3e-341fbecc2a4a tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] 10.222.0.79 "GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1" status: 200 len: 1315 microversion: 2.1 time: 0.177508 Jul 04 10:16:22.665090 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 431/865] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:22 2022] GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:23.189228 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-402b6e01-4942-4a21-902d-842d96247862 req-20ee06a6-aca8-4478-86a8-3fec21e3fb90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffd80713-357e-41a4-8c07-866bb74d13a1", "name": "network-vif-plugged", "status": "completed", "tag": "e98bf53e-6975-4a7e-8a41-581d26361119"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:16:23.199087 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-402b6e01-4942-4a21-902d-842d96247862 req-20ee06a6-aca8-4478-86a8-3fec21e3fb90 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:23.199650 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-402b6e01-4942-4a21-902d-842d96247862 req-20ee06a6-aca8-4478-86a8-3fec21e3fb90 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:23.216523 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-402b6e01-4942-4a21-902d-842d96247862 req-20ee06a6-aca8-4478-86a8-3fec21e3fb90 service nova] Creating event network-vif-plugged:e98bf53e-6975-4a7e-8a41-581d26361119 for instance ffd80713-357e-41a4-8c07-866bb74d13a1 on hv-cinder-84841 Jul 04 10:16:23.221594 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-402b6e01-4942-4a21-902d-842d96247862 req-20ee06a6-aca8-4478-86a8-3fec21e3fb90 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036330 Jul 04 10:16:23.222307 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 435/866] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:16:23.681457 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-de2df086-2548-490c-b49a-2d122d628ce9 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:23.682077 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-de2df086-2548-490c-b49a-2d122d628ce9 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] [instance: ffd80713-357e-41a4-8c07-866bb74d13a1] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:23.689601 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-de2df086-2548-490c-b49a-2d122d628ce9 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:23.690222 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-de2df086-2548-490c-b49a-2d122d628ce9 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:23.690999 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-de2df086-2548-490c-b49a-2d122d628ce9 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:23.691525 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-de2df086-2548-490c-b49a-2d122d628ce9 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:23.822637 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-de2df086-2548-490c-b49a-2d122d628ce9 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f80d61cfbe949a7a55d565de30b63ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10baff2f6e0a421d8050f69d97e6c7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:23.830137 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-de2df086-2548-490c-b49a-2d122d628ce9 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] 10.222.0.79 "GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1" status: 200 len: 1315 microversion: 2.1 time: 0.152788 Jul 04 10:16:23.830703 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 432/867] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:23 2022] GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:24.849662 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-860cb0f5-835a-4fa2-acbc-63a2db506912 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:24.850331 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-860cb0f5-835a-4fa2-acbc-63a2db506912 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] [instance: ffd80713-357e-41a4-8c07-866bb74d13a1] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:24.859583 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-860cb0f5-835a-4fa2-acbc-63a2db506912 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:24.860039 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-860cb0f5-835a-4fa2-acbc-63a2db506912 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:24.861142 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-860cb0f5-835a-4fa2-acbc-63a2db506912 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:24.861592 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-860cb0f5-835a-4fa2-acbc-63a2db506912 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:25.031694 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-860cb0f5-835a-4fa2-acbc-63a2db506912 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f80d61cfbe949a7a55d565de30b63ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10baff2f6e0a421d8050f69d97e6c7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:25.039828 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-860cb0f5-835a-4fa2-acbc-63a2db506912 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] 10.222.0.79 "GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1" status: 200 len: 1315 microversion: 2.1 time: 0.194922 Jul 04 10:16:25.040325 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 436/868] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:24 2022] GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:26.056590 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-d2382380-b711-430e-aedb-58af7425ea5a tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:26.057277 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d2382380-b711-430e-aedb-58af7425ea5a tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] [instance: ffd80713-357e-41a4-8c07-866bb74d13a1] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:26.064405 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d2382380-b711-430e-aedb-58af7425ea5a tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:26.064929 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d2382380-b711-430e-aedb-58af7425ea5a tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:26.065879 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d2382380-b711-430e-aedb-58af7425ea5a tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:26.066371 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d2382380-b711-430e-aedb-58af7425ea5a tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:26.292164 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-d2382380-b711-430e-aedb-58af7425ea5a tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f80d61cfbe949a7a55d565de30b63ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10baff2f6e0a421d8050f69d97e6c7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:26.300297 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-d2382380-b711-430e-aedb-58af7425ea5a tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] 10.222.0.79 "GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1" status: 200 len: 1315 microversion: 2.1 time: 0.247639 Jul 04 10:16:26.300860 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 433/869] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:26 2022] GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:26.799608 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-9ed7fa8d-8094-4056-838e-64d3364c5298 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:26.800112 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-9ed7fa8d-8094-4056-838e-64d3364c5298 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:26.800949 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-3e74ad67-4196-4c38-8333-c4c5601350dc req-6395bcfd-04cd-4197-81f7-dfdf86b165ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9526d9a-e0e4-4708-a2da-872d57732128", "tag": "0561989e-f05a-46b1-a7cf-00085ff7229a"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:16:26.807306 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9ed7fa8d-8094-4056-838e-64d3364c5298 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:26.808046 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9ed7fa8d-8094-4056-838e-64d3364c5298 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:26.808881 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9ed7fa8d-8094-4056-838e-64d3364c5298 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:26.808992 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-3e74ad67-4196-4c38-8333-c4c5601350dc req-6395bcfd-04cd-4197-81f7-dfdf86b165ac service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:26.809332 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-3e74ad67-4196-4c38-8333-c4c5601350dc req-6395bcfd-04cd-4197-81f7-dfdf86b165ac service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:26.809443 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-9ed7fa8d-8094-4056-838e-64d3364c5298 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:26.820714 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-3e74ad67-4196-4c38-8333-c4c5601350dc req-6395bcfd-04cd-4197-81f7-dfdf86b165ac service nova] Creating event network-changed:0561989e-f05a-46b1-a7cf-00085ff7229a for instance f9526d9a-e0e4-4708-a2da-872d57732128 on hv-cinder-84841 Jul 04 10:16:26.825709 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-3e74ad67-4196-4c38-8333-c4c5601350dc req-6395bcfd-04cd-4197-81f7-dfdf86b165ac service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028290 Jul 04 10:16:26.826471 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 434/870] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 10:16:26.838787 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-9ed7fa8d-8094-4056-838e-64d3364c5298 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Going to try to terminate instance {{(pid=117866) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 10:16:26.926906 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-9ed7fa8d-8094-4056-838e-64d3364c5298 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 204 len: 0 microversion: 2.1 time: 0.131250 Jul 04 10:16:26.927722 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 437/871] 10.222.0.79 () {58 vars in 1238 bytes} [Mon Jul 4 10:16:26 2022] DELETE /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 10:16:26.937609 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-ac99fa4b-acd2-4405-a4ab-2d30c42a90d8 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:26.938316 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-ac99fa4b-acd2-4405-a4ab-2d30c42a90d8 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:26.951842 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ac99fa4b-acd2-4405-a4ab-2d30c42a90d8 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:26.952456 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ac99fa4b-acd2-4405-a4ab-2d30c42a90d8 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:26.953682 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ac99fa4b-acd2-4405-a4ab-2d30c42a90d8 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:26.954313 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ac99fa4b-acd2-4405-a4ab-2d30c42a90d8 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:27.148059 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-ac99fa4b-acd2-4405-a4ab-2d30c42a90d8 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:27.155874 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-ac99fa4b-acd2-4405-a4ab-2d30c42a90d8 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1567 microversion: 2.1 time: 0.222968 Jul 04 10:16:27.156563 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 435/872] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:26 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1567 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:27.198807 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-1fa920c5-e628-4e81-88fe-fcacddcf2efb tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:27.199393 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-1fa920c5-e628-4e81-88fe-fcacddcf2efb tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: d2a1784f-42f6-4008-8876-e94fe9c5b2e5] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:27.206178 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1fa920c5-e628-4e81-88fe-fcacddcf2efb tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:27.206812 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1fa920c5-e628-4e81-88fe-fcacddcf2efb tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:27.207579 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1fa920c5-e628-4e81-88fe-fcacddcf2efb tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:27.208011 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1fa920c5-e628-4e81-88fe-fcacddcf2efb tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:27.295301 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.objects.instance [None req-1fa920c5-e628-4e81-88fe-fcacddcf2efb tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lazy-loading 'services' on Instance uuid d2a1784f-42f6-4008-8876-e94fe9c5b2e5 {{(pid=117866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 10:16:27.318273 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b00454b0-65e6-4509-896c-172e57e0d3c1 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:27.318875 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-b00454b0-65e6-4509-896c-172e57e0d3c1 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] [instance: ffd80713-357e-41a4-8c07-866bb74d13a1] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:27.325062 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b00454b0-65e6-4509-896c-172e57e0d3c1 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:27.325505 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b00454b0-65e6-4509-896c-172e57e0d3c1 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:27.326303 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b00454b0-65e6-4509-896c-172e57e0d3c1 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:27.326729 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b00454b0-65e6-4509-896c-172e57e0d3c1 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:27.374194 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-1fa920c5-e628-4e81-88fe-fcacddcf2efb tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5/os-volume_attachments/23ede016-935e-4424-a9ee-f6415d6016db" status: 202 len: 0 microversion: 2.1 time: 0.179367 Jul 04 10:16:27.388501 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 438/873] 10.222.0.79 () {58 vars in 1415 bytes} [Mon Jul 4 10:16:27 2022] DELETE /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5/os-volume_attachments/23ede016-935e-4424-a9ee-f6415d6016db => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 10:16:27.463245 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-b00454b0-65e6-4509-896c-172e57e0d3c1 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f80d61cfbe949a7a55d565de30b63ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10baff2f6e0a421d8050f69d97e6c7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:27.471994 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-b00454b0-65e6-4509-896c-172e57e0d3c1 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] 10.222.0.79 "GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1" status: 200 len: 1315 microversion: 2.1 time: 0.157450 Jul 04 10:16:27.472580 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 436/874] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:27 2022] GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:28.175166 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-18ab0808-d662-4fd8-8b9e-6b0f047804f7 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:28.176111 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-18ab0808-d662-4fd8-8b9e-6b0f047804f7 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:28.183190 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-18ab0808-d662-4fd8-8b9e-6b0f047804f7 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:28.183638 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-18ab0808-d662-4fd8-8b9e-6b0f047804f7 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:28.184402 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-18ab0808-d662-4fd8-8b9e-6b0f047804f7 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:28.184830 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-18ab0808-d662-4fd8-8b9e-6b0f047804f7 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:28.357487 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-18ab0808-d662-4fd8-8b9e-6b0f047804f7 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:28.365668 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-18ab0808-d662-4fd8-8b9e-6b0f047804f7 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1567 microversion: 2.1 time: 0.195252 Jul 04 10:16:28.366452 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 439/875] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:28 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1567 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:28.488304 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-dd6234cb-3368-4113-9f89-0430e3ba91a2 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:28.490129 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-dd6234cb-3368-4113-9f89-0430e3ba91a2 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] [instance: ffd80713-357e-41a4-8c07-866bb74d13a1] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:28.497751 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-dd6234cb-3368-4113-9f89-0430e3ba91a2 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:28.498167 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-dd6234cb-3368-4113-9f89-0430e3ba91a2 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:28.498934 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-dd6234cb-3368-4113-9f89-0430e3ba91a2 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:28.499368 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-dd6234cb-3368-4113-9f89-0430e3ba91a2 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:28.661978 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-dd6234cb-3368-4113-9f89-0430e3ba91a2 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f80d61cfbe949a7a55d565de30b63ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10baff2f6e0a421d8050f69d97e6c7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:28.673232 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-dd6234cb-3368-4113-9f89-0430e3ba91a2 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] 10.222.0.79 "GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1" status: 200 len: 1465 microversion: 2.1 time: 0.188543 Jul 04 10:16:28.673909 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 437/876] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:28 2022] GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1 => generated 1465 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:28.719114 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-dc79e9c5-e81e-4822-9b2a-fef3f5f061cc tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:28.719725 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-dc79e9c5-e81e-4822-9b2a-fef3f5f061cc tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] [instance: ffd80713-357e-41a4-8c07-866bb74d13a1] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:28.728732 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-dc79e9c5-e81e-4822-9b2a-fef3f5f061cc tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:28.729175 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-dc79e9c5-e81e-4822-9b2a-fef3f5f061cc tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:28.729976 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-dc79e9c5-e81e-4822-9b2a-fef3f5f061cc tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:28.730408 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-dc79e9c5-e81e-4822-9b2a-fef3f5f061cc tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:28.756194 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-dc79e9c5-e81e-4822-9b2a-fef3f5f061cc tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] [instance: ffd80713-357e-41a4-8c07-866bb74d13a1] Going to try to terminate instance {{(pid=117866) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 10:16:28.845597 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-dc79e9c5-e81e-4822-9b2a-fef3f5f061cc tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1" status: 204 len: 0 microversion: 2.1 time: 0.132257 Jul 04 10:16:28.846459 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 440/877] 10.222.0.79 () {58 vars in 1238 bytes} [Mon Jul 4 10:16:28 2022] DELETE /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 10:16:28.855338 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-c10a5bb2-b0ae-4f50-88f5-79724e4845fe tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:28.855955 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-c10a5bb2-b0ae-4f50-88f5-79724e4845fe tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] [instance: ffd80713-357e-41a4-8c07-866bb74d13a1] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:28.862317 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c10a5bb2-b0ae-4f50-88f5-79724e4845fe tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:28.862701 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c10a5bb2-b0ae-4f50-88f5-79724e4845fe tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:28.863816 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c10a5bb2-b0ae-4f50-88f5-79724e4845fe tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:28.864411 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c10a5bb2-b0ae-4f50-88f5-79724e4845fe tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:29.007609 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-c10a5bb2-b0ae-4f50-88f5-79724e4845fe tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f80d61cfbe949a7a55d565de30b63ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10baff2f6e0a421d8050f69d97e6c7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:29.015613 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-c10a5bb2-b0ae-4f50-88f5-79724e4845fe tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] 10.222.0.79 "GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1" status: 200 len: 1471 microversion: 2.1 time: 0.164427 Jul 04 10:16:29.016287 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 438/878] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:28 2022] GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1 => generated 1471 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:29.384843 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-625d0496-3b75-4755-9149-f4b076811e2c tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:29.385720 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-625d0496-3b75-4755-9149-f4b076811e2c tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:29.393758 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-625d0496-3b75-4755-9149-f4b076811e2c tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:29.394493 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-625d0496-3b75-4755-9149-f4b076811e2c tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:29.395648 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-625d0496-3b75-4755-9149-f4b076811e2c tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:29.396282 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-625d0496-3b75-4755-9149-f4b076811e2c tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:29.559316 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-625d0496-3b75-4755-9149-f4b076811e2c tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:29.568069 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-625d0496-3b75-4755-9149-f4b076811e2c tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1567 microversion: 2.1 time: 0.187380 Jul 04 10:16:29.568792 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 441/879] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:29 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:16:30.037090 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-01cf0b69-c435-45c7-8bc1-0f423e2b76f8 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:30.038065 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-01cf0b69-c435-45c7-8bc1-0f423e2b76f8 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] [instance: ffd80713-357e-41a4-8c07-866bb74d13a1] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:30.049213 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-01cf0b69-c435-45c7-8bc1-0f423e2b76f8 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:30.050048 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-01cf0b69-c435-45c7-8bc1-0f423e2b76f8 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:30.051302 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-01cf0b69-c435-45c7-8bc1-0f423e2b76f8 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:30.052016 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-01cf0b69-c435-45c7-8bc1-0f423e2b76f8 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:30.191660 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-01cf0b69-c435-45c7-8bc1-0f423e2b76f8 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f80d61cfbe949a7a55d565de30b63ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10baff2f6e0a421d8050f69d97e6c7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:30.199916 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-01cf0b69-c435-45c7-8bc1-0f423e2b76f8 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] 10.222.0.79 "GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1" status: 200 len: 1471 microversion: 2.1 time: 0.169651 Jul 04 10:16:30.200490 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 439/880] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:30 2022] GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1 => generated 1471 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:30.585573 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-4f0298d5-535a-436e-aa78-12351da59913 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:30.586239 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-4f0298d5-535a-436e-aa78-12351da59913 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:30.595966 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-4f0298d5-535a-436e-aa78-12351da59913 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:30.596412 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-4f0298d5-535a-436e-aa78-12351da59913 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:30.597163 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-4f0298d5-535a-436e-aa78-12351da59913 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:30.597609 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-4f0298d5-535a-436e-aa78-12351da59913 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:31.030154 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-4f0298d5-535a-436e-aa78-12351da59913 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:31.041701 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-4f0298d5-535a-436e-aa78-12351da59913 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1567 microversion: 2.1 time: 0.455898 Jul 04 10:16:31.042669 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 442/881] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:30 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1567 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:31.220181 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-4994bd1f-adcc-499d-9294-5ade967a04d6 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:31.221740 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-4994bd1f-adcc-499d-9294-5ade967a04d6 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] [instance: ffd80713-357e-41a4-8c07-866bb74d13a1] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:31.230600 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4994bd1f-adcc-499d-9294-5ade967a04d6 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:31.231337 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4994bd1f-adcc-499d-9294-5ade967a04d6 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:31.232116 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4994bd1f-adcc-499d-9294-5ade967a04d6 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:31.232705 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4994bd1f-adcc-499d-9294-5ade967a04d6 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:31.304600 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-4994bd1f-adcc-499d-9294-5ade967a04d6 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f80d61cfbe949a7a55d565de30b63ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10baff2f6e0a421d8050f69d97e6c7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:31.328791 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-4994bd1f-adcc-499d-9294-5ade967a04d6 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] 10.222.0.79 "GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1" status: 200 len: 1429 microversion: 2.1 time: 0.114045 Jul 04 10:16:31.339379 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 440/882] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:31 2022] GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1 => generated 1429 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:31.522913 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-75fe5c26-5f9d-4c38-b598-0e7ad63350f8 req-580ccebd-ceb9-4ac9-baf7-e48aee5365f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9526d9a-e0e4-4708-a2da-872d57732128", "name": "network-vif-deleted", "tag": "0561989e-f05a-46b1-a7cf-00085ff7229a"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:16:31.532604 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-75fe5c26-5f9d-4c38-b598-0e7ad63350f8 req-580ccebd-ceb9-4ac9-baf7-e48aee5365f7 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:31.533386 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-75fe5c26-5f9d-4c38-b598-0e7ad63350f8 req-580ccebd-ceb9-4ac9-baf7-e48aee5365f7 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:31.555951 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-75fe5c26-5f9d-4c38-b598-0e7ad63350f8 req-580ccebd-ceb9-4ac9-baf7-e48aee5365f7 service nova] Creating event network-vif-deleted:0561989e-f05a-46b1-a7cf-00085ff7229a for instance f9526d9a-e0e4-4708-a2da-872d57732128 on hv-cinder-84841 Jul 04 10:16:31.562481 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-75fe5c26-5f9d-4c38-b598-0e7ad63350f8 req-580ccebd-ceb9-4ac9-baf7-e48aee5365f7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042985 Jul 04 10:16:31.563246 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 441/883] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:16:31.580027 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-2a746cad-e971-4e33-813c-308c4d59b084 req-c87c25f9-b900-452c-930f-4debcbbb478e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffd80713-357e-41a4-8c07-866bb74d13a1", "name": "network-vif-deleted", "tag": "e98bf53e-6975-4a7e-8a41-581d26361119"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:16:31.588335 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-2a746cad-e971-4e33-813c-308c4d59b084 req-c87c25f9-b900-452c-930f-4debcbbb478e service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:31.588920 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-2a746cad-e971-4e33-813c-308c4d59b084 req-c87c25f9-b900-452c-930f-4debcbbb478e service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:31.600122 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-2a746cad-e971-4e33-813c-308c4d59b084 req-c87c25f9-b900-452c-930f-4debcbbb478e service nova] Creating event network-vif-deleted:e98bf53e-6975-4a7e-8a41-581d26361119 for instance ffd80713-357e-41a4-8c07-866bb74d13a1 on hv-cinder-84841 Jul 04 10:16:31.605580 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-2a746cad-e971-4e33-813c-308c4d59b084 req-c87c25f9-b900-452c-930f-4debcbbb478e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.225729 Jul 04 10:16:31.606236 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 443/884] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:16:32.011951 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-d8e16238-1086-4ee1-89ce-b81fd9429a2b tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:32.012585 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d8e16238-1086-4ee1-89ce-b81fd9429a2b tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: d2a1784f-42f6-4008-8876-e94fe9c5b2e5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:32.019845 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d8e16238-1086-4ee1-89ce-b81fd9429a2b tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:32.020291 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d8e16238-1086-4ee1-89ce-b81fd9429a2b tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:32.021048 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d8e16238-1086-4ee1-89ce-b81fd9429a2b tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:32.021471 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d8e16238-1086-4ee1-89ce-b81fd9429a2b tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:32.046414 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d8e16238-1086-4ee1-89ce-b81fd9429a2b tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: d2a1784f-42f6-4008-8876-e94fe9c5b2e5] Going to try to terminate instance {{(pid=117865) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 10:16:32.067282 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-37260eab-2549-4e00-93bb-1a22fbc4df3c tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:32.068262 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-37260eab-2549-4e00-93bb-1a22fbc4df3c tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:32.076782 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-37260eab-2549-4e00-93bb-1a22fbc4df3c tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:32.077221 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-37260eab-2549-4e00-93bb-1a22fbc4df3c tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:32.077976 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-37260eab-2549-4e00-93bb-1a22fbc4df3c tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:32.078397 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-37260eab-2549-4e00-93bb-1a22fbc4df3c tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:32.137817 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-d8e16238-1086-4ee1-89ce-b81fd9429a2b tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5" status: 204 len: 0 microversion: 2.1 time: 0.129779 Jul 04 10:16:32.138559 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 442/885] 10.222.0.79 () {58 vars in 1238 bytes} [Mon Jul 4 10:16:32 2022] DELETE /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 10:16:32.146824 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-37260eab-2549-4e00-93bb-1a22fbc4df3c tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:32.152437 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-cfebdbce-1e37-4ef9-bc21-7d84f73a51ef tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:32.153351 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-cfebdbce-1e37-4ef9-bc21-7d84f73a51ef tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: d2a1784f-42f6-4008-8876-e94fe9c5b2e5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:32.156569 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-37260eab-2549-4e00-93bb-1a22fbc4df3c tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1218 microversion: 2.1 time: 0.095846 Jul 04 10:16:32.157313 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 444/886] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:32 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:32.166183 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cfebdbce-1e37-4ef9-bc21-7d84f73a51ef tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:32.166183 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cfebdbce-1e37-4ef9-bc21-7d84f73a51ef tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:32.166183 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cfebdbce-1e37-4ef9-bc21-7d84f73a51ef tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:32.166714 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cfebdbce-1e37-4ef9-bc21-7d84f73a51ef tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:32.306818 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-cfebdbce-1e37-4ef9-bc21-7d84f73a51ef tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495a8406c184164982d136edc351cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02795b95a9b84564999233883b763e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:32.314731 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-cfebdbce-1e37-4ef9-bc21-7d84f73a51ef tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5" status: 200 len: 1514 microversion: 2.1 time: 0.167841 Jul 04 10:16:32.315595 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 443/887] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:32 2022] GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5 => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:16:32.346974 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-22275563-ab19-4724-b594-6e0670e0f71f tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:32.347583 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-22275563-ab19-4724-b594-6e0670e0f71f tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] [instance: ffd80713-357e-41a4-8c07-866bb74d13a1] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:32.354124 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-22275563-ab19-4724-b594-6e0670e0f71f tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:32.354608 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-22275563-ab19-4724-b594-6e0670e0f71f tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:32.355378 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-22275563-ab19-4724-b594-6e0670e0f71f tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:32.355810 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-22275563-ab19-4724-b594-6e0670e0f71f tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:32.387402 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-22275563-ab19-4724-b594-6e0670e0f71f tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:32.387841 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-22275563-ab19-4724-b594-6e0670e0f71f tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:32.388285 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.objects.instance [None req-22275563-ab19-4724-b594-6e0670e0f71f tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lazy-loading 'fault' on Instance uuid ffd80713-357e-41a4-8c07-866bb74d13a1 {{(pid=117866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 10:16:32.430571 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-22275563-ab19-4724-b594-6e0670e0f71f tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f80d61cfbe949a7a55d565de30b63ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10baff2f6e0a421d8050f69d97e6c7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:32.441858 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-22275563-ab19-4724-b594-6e0670e0f71f tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] 10.222.0.79 "GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1" status: 200 len: 1305 microversion: 2.1 time: 0.098491 Jul 04 10:16:32.442728 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 445/888] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:32 2022] GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1 => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:33.177578 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-a0ad1139-3bc6-43f9-bb43-e7eabff2972d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:33.178609 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-a0ad1139-3bc6-43f9-bb43-e7eabff2972d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:33.189307 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a0ad1139-3bc6-43f9-bb43-e7eabff2972d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:33.190095 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a0ad1139-3bc6-43f9-bb43-e7eabff2972d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:33.191326 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a0ad1139-3bc6-43f9-bb43-e7eabff2972d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:33.192028 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a0ad1139-3bc6-43f9-bb43-e7eabff2972d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:33.256042 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-a0ad1139-3bc6-43f9-bb43-e7eabff2972d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:33.263974 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-a0ad1139-3bc6-43f9-bb43-e7eabff2972d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1218 microversion: 2.1 time: 0.092917 Jul 04 10:16:33.264535 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 444/889] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:33 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:33.336256 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-3f37365a-0b7c-43be-9942-da07e23fe7e2 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:33.337674 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-3f37365a-0b7c-43be-9942-da07e23fe7e2 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: d2a1784f-42f6-4008-8876-e94fe9c5b2e5] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:33.349051 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3f37365a-0b7c-43be-9942-da07e23fe7e2 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:33.349868 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3f37365a-0b7c-43be-9942-da07e23fe7e2 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:33.351124 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3f37365a-0b7c-43be-9942-da07e23fe7e2 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:33.351854 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3f37365a-0b7c-43be-9942-da07e23fe7e2 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:33.459709 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-1f11a51d-3d04-4dd0-b4cd-11638da7beb5 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:33.460327 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-1f11a51d-3d04-4dd0-b4cd-11638da7beb5 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] [instance: ffd80713-357e-41a4-8c07-866bb74d13a1] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:33.466857 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1f11a51d-3d04-4dd0-b4cd-11638da7beb5 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:33.467297 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1f11a51d-3d04-4dd0-b4cd-11638da7beb5 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:33.468056 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1f11a51d-3d04-4dd0-b4cd-11638da7beb5 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:33.468480 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1f11a51d-3d04-4dd0-b4cd-11638da7beb5 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:33.485993 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-3f37365a-0b7c-43be-9942-da07e23fe7e2 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495a8406c184164982d136edc351cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02795b95a9b84564999233883b763e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:33.488570 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:16:33.495348 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-3f37365a-0b7c-43be-9942-da07e23fe7e2 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5" status: 200 len: 1514 microversion: 2.1 time: 0.165449 Jul 04 10:16:33.496141 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 446/890] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:33 2022] GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:33.500774 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1f11a51d-3d04-4dd0-b4cd-11638da7beb5 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:33.501247 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1f11a51d-3d04-4dd0-b4cd-11638da7beb5 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:33.501701 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.objects.instance [None req-1f11a51d-3d04-4dd0-b4cd-11638da7beb5 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lazy-loading 'fault' on Instance uuid ffd80713-357e-41a4-8c07-866bb74d13a1 {{(pid=117865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 10:16:33.552965 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-1f11a51d-3d04-4dd0-b4cd-11638da7beb5 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f80d61cfbe949a7a55d565de30b63ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10baff2f6e0a421d8050f69d97e6c7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:33.561997 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-1f11a51d-3d04-4dd0-b4cd-11638da7beb5 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] 10.222.0.79 "GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1" status: 200 len: 1305 microversion: 2.1 time: 0.106206 Jul 04 10:16:33.562548 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 445/891] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:33 2022] GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1 => generated 1305 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:34.280679 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-723e4bf6-c649-420d-a55e-c1e123b1a67d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:34.281302 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-723e4bf6-c649-420d-a55e-c1e123b1a67d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:34.288673 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-723e4bf6-c649-420d-a55e-c1e123b1a67d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:34.289115 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-723e4bf6-c649-420d-a55e-c1e123b1a67d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:34.289898 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-723e4bf6-c649-420d-a55e-c1e123b1a67d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:34.290327 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-723e4bf6-c649-420d-a55e-c1e123b1a67d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:34.351952 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-723e4bf6-c649-420d-a55e-c1e123b1a67d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:34.359573 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-723e4bf6-c649-420d-a55e-c1e123b1a67d tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1218 microversion: 2.1 time: 0.083105 Jul 04 10:16:34.360110 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 447/892] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:34 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:34.515573 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-d1f82174-8710-42ad-b993-d2d78919ef26 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:34.516225 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d1f82174-8710-42ad-b993-d2d78919ef26 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: d2a1784f-42f6-4008-8876-e94fe9c5b2e5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:34.526797 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d1f82174-8710-42ad-b993-d2d78919ef26 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:34.527256 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d1f82174-8710-42ad-b993-d2d78919ef26 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:34.528118 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d1f82174-8710-42ad-b993-d2d78919ef26 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:34.528556 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d1f82174-8710-42ad-b993-d2d78919ef26 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:34.531392 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:16:34.580425 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-676a920c-c060-4b9f-8cd7-b6bde47e15dd tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:34.581051 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-676a920c-c060-4b9f-8cd7-b6bde47e15dd tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] [instance: ffd80713-357e-41a4-8c07-866bb74d13a1] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:34.588034 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-676a920c-c060-4b9f-8cd7-b6bde47e15dd tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:34.588516 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-676a920c-c060-4b9f-8cd7-b6bde47e15dd tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:34.589278 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-676a920c-c060-4b9f-8cd7-b6bde47e15dd tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:34.589748 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-676a920c-c060-4b9f-8cd7-b6bde47e15dd tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:34.623639 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-676a920c-c060-4b9f-8cd7-b6bde47e15dd tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:34.624223 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-676a920c-c060-4b9f-8cd7-b6bde47e15dd tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:34.624638 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.objects.instance [None req-676a920c-c060-4b9f-8cd7-b6bde47e15dd tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lazy-loading 'fault' on Instance uuid ffd80713-357e-41a4-8c07-866bb74d13a1 {{(pid=117866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 10:16:34.926396 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-676a920c-c060-4b9f-8cd7-b6bde47e15dd tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f80d61cfbe949a7a55d565de30b63ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10baff2f6e0a421d8050f69d97e6c7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:34.934600 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-676a920c-c060-4b9f-8cd7-b6bde47e15dd tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] 10.222.0.79 "GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1" status: 200 len: 1305 microversion: 2.1 time: 0.358068 Jul 04 10:16:34.935176 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 448/893] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:34 2022] GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1 => generated 1305 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:16:34.949496 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-d1f82174-8710-42ad-b993-d2d78919ef26 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495a8406c184164982d136edc351cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02795b95a9b84564999233883b763e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:34.958487 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-d1f82174-8710-42ad-b993-d2d78919ef26 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5" status: 200 len: 1514 microversion: 2.1 time: 0.449694 Jul 04 10:16:34.959064 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 446/894] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:34 2022] GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5 => generated 1514 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:35.378937 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-b76b29ba-dd8b-4413-a07f-d2952cba1dd8 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:35.379539 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-b76b29ba-dd8b-4413-a07f-d2952cba1dd8 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:35.389609 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b76b29ba-dd8b-4413-a07f-d2952cba1dd8 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:35.390295 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b76b29ba-dd8b-4413-a07f-d2952cba1dd8 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:35.391381 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b76b29ba-dd8b-4413-a07f-d2952cba1dd8 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:35.391927 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b76b29ba-dd8b-4413-a07f-d2952cba1dd8 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:35.456300 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-b76b29ba-dd8b-4413-a07f-d2952cba1dd8 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:35.464147 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-b76b29ba-dd8b-4413-a07f-d2952cba1dd8 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1218 microversion: 2.1 time: 0.091208 Jul 04 10:16:35.464699 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 449/895] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:35 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:35.957191 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-d0af2615-b8df-429a-9e11-815cb08c6077 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:35.958236 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d0af2615-b8df-429a-9e11-815cb08c6077 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] [instance: ffd80713-357e-41a4-8c07-866bb74d13a1] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:35.967264 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d0af2615-b8df-429a-9e11-815cb08c6077 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:35.967706 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d0af2615-b8df-429a-9e11-815cb08c6077 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:35.968461 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d0af2615-b8df-429a-9e11-815cb08c6077 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:35.968889 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d0af2615-b8df-429a-9e11-815cb08c6077 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:35.976310 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-0d71cfa3-87d3-4dd9-822d-54a530cb7923 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:35.976917 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-0d71cfa3-87d3-4dd9-822d-54a530cb7923 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: d2a1784f-42f6-4008-8876-e94fe9c5b2e5] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:35.983594 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0d71cfa3-87d3-4dd9-822d-54a530cb7923 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:35.984043 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0d71cfa3-87d3-4dd9-822d-54a530cb7923 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:35.984805 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0d71cfa3-87d3-4dd9-822d-54a530cb7923 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:35.985234 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0d71cfa3-87d3-4dd9-822d-54a530cb7923 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:36.002446 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d0af2615-b8df-429a-9e11-815cb08c6077 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:36.002879 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d0af2615-b8df-429a-9e11-815cb08c6077 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:36.003310 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.objects.instance [None req-d0af2615-b8df-429a-9e11-815cb08c6077 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lazy-loading 'fault' on Instance uuid ffd80713-357e-41a4-8c07-866bb74d13a1 {{(pid=117865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 10:16:36.050185 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-d0af2615-b8df-429a-9e11-815cb08c6077 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f80d61cfbe949a7a55d565de30b63ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10baff2f6e0a421d8050f69d97e6c7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:36.058420 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-d0af2615-b8df-429a-9e11-815cb08c6077 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] 10.222.0.79 "GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1" status: 200 len: 1305 microversion: 2.1 time: 0.108505 Jul 04 10:16:36.059254 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 447/896] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:35 2022] GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1 => generated 1305 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:36.137549 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-0d71cfa3-87d3-4dd9-822d-54a530cb7923 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495a8406c184164982d136edc351cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02795b95a9b84564999233883b763e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:36.145373 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-0d71cfa3-87d3-4dd9-822d-54a530cb7923 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5" status: 200 len: 1514 microversion: 2.1 time: 0.172895 Jul 04 10:16:36.145939 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 450/897] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:35 2022] GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5 => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:36.480578 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-3a448d5b-5792-47db-99a8-53c1731f8a08 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:36.481175 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-3a448d5b-5792-47db-99a8-53c1731f8a08 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:36.487451 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3a448d5b-5792-47db-99a8-53c1731f8a08 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:36.487891 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3a448d5b-5792-47db-99a8-53c1731f8a08 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:36.488640 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3a448d5b-5792-47db-99a8-53c1731f8a08 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:36.489067 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3a448d5b-5792-47db-99a8-53c1731f8a08 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:36.557702 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-3a448d5b-5792-47db-99a8-53c1731f8a08 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:36.565223 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-3a448d5b-5792-47db-99a8-53c1731f8a08 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1218 microversion: 2.1 time: 0.088702 Jul 04 10:16:36.565805 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 448/898] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:36 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:37.079749 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-618c21cf-18c3-4402-96de-5f94fd3a7a70 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:37.080756 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-618c21cf-18c3-4402-96de-5f94fd3a7a70 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] [instance: ffd80713-357e-41a4-8c07-866bb74d13a1] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:37.092215 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-618c21cf-18c3-4402-96de-5f94fd3a7a70 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:37.092942 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-618c21cf-18c3-4402-96de-5f94fd3a7a70 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:37.094252 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-618c21cf-18c3-4402-96de-5f94fd3a7a70 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:37.094995 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-618c21cf-18c3-4402-96de-5f94fd3a7a70 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:37.129963 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-618c21cf-18c3-4402-96de-5f94fd3a7a70 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:37.130366 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-618c21cf-18c3-4402-96de-5f94fd3a7a70 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:37.130834 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.objects.instance [None req-618c21cf-18c3-4402-96de-5f94fd3a7a70 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lazy-loading 'fault' on Instance uuid ffd80713-357e-41a4-8c07-866bb74d13a1 {{(pid=117866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 10:16:37.163393 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-cd32a3e6-fa45-4bd0-83eb-65729dc5c37c tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:37.163978 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-cd32a3e6-fa45-4bd0-83eb-65729dc5c37c tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: d2a1784f-42f6-4008-8876-e94fe9c5b2e5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:37.171365 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cd32a3e6-fa45-4bd0-83eb-65729dc5c37c tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:37.171817 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cd32a3e6-fa45-4bd0-83eb-65729dc5c37c tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:37.172584 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cd32a3e6-fa45-4bd0-83eb-65729dc5c37c tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:37.173016 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cd32a3e6-fa45-4bd0-83eb-65729dc5c37c tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:37.173319 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-618c21cf-18c3-4402-96de-5f94fd3a7a70 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f80d61cfbe949a7a55d565de30b63ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10baff2f6e0a421d8050f69d97e6c7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:37.180937 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-618c21cf-18c3-4402-96de-5f94fd3a7a70 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] 10.222.0.79 "GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1" status: 200 len: 1305 microversion: 2.1 time: 0.107628 Jul 04 10:16:37.181672 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 451/899] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:37 2022] GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1 => generated 1305 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:37.310023 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-cd32a3e6-fa45-4bd0-83eb-65729dc5c37c tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495a8406c184164982d136edc351cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02795b95a9b84564999233883b763e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:37.323387 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-cd32a3e6-fa45-4bd0-83eb-65729dc5c37c tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5" status: 200 len: 1514 microversion: 2.1 time: 0.162796 Jul 04 10:16:37.323790 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 449/900] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:37 2022] GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:37.582310 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-b178dfc8-0899-4e67-8d01-9f0211212947 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:37.582965 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-b178dfc8-0899-4e67-8d01-9f0211212947 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:37.589748 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b178dfc8-0899-4e67-8d01-9f0211212947 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:37.590198 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b178dfc8-0899-4e67-8d01-9f0211212947 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:37.590949 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b178dfc8-0899-4e67-8d01-9f0211212947 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:37.591368 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-b178dfc8-0899-4e67-8d01-9f0211212947 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:37.695302 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-b178dfc8-0899-4e67-8d01-9f0211212947 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c009e1bcd74151ad3fa95c68916329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d7bb97464d4807a6b7bbac9a41dc67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:37.704668 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-b178dfc8-0899-4e67-8d01-9f0211212947 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 200 len: 1218 microversion: 2.1 time: 0.126157 Jul 04 10:16:37.705697 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 452/901] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:37 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 1218 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:38.198636 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-7d7b43c2-dd13-4db1-87e3-3f059f747534 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:38.199791 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-7d7b43c2-dd13-4db1-87e3-3f059f747534 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] [instance: ffd80713-357e-41a4-8c07-866bb74d13a1] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:38.208347 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7d7b43c2-dd13-4db1-87e3-3f059f747534 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:38.208975 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7d7b43c2-dd13-4db1-87e3-3f059f747534 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:38.209983 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7d7b43c2-dd13-4db1-87e3-3f059f747534 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:38.210407 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7d7b43c2-dd13-4db1-87e3-3f059f747534 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:38.225542 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-7d7b43c2-dd13-4db1-87e3-3f059f747534 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] HTTP exception thrown: Instance ffd80713-357e-41a4-8c07-866bb74d13a1 could not be found. Jul 04 10:16:38.227251 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-7d7b43c2-dd13-4db1-87e3-3f059f747534 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Request method failure captured: Jul 04 10:16:38.227251 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: request: GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1 HTTP/1.1 Jul 04 10:16:38.227251 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept: application/json Jul 04 10:16:38.227251 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept-Encoding: identity Jul 04 10:16:38.227251 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Connection: close Jul 04 10:16:38.227251 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Length: 0 Jul 04 10:16:38.227251 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Type: application/json Jul 04 10:16:38.227251 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Host: 10.222.0.79 Jul 04 10:16:38.227251 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 04 10:16:38.227251 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 04 10:16:38.227251 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Auth-Token: gAAAAABiwr3i-Na05mljV895KtBWW2vz8eDfj4wNvecd-cCZ1N8KkEavenIJIPA3tZZHjVZYOW_OMx5JlyINQwtnyPUOB0b2ybJKE-K0dqdOzvSul9IE8nyVKgCfw3jvDrdz2CE7Wi2gMdZdAybuJ_LH74xk9JDW-_dMSfU-gmZrNROaI_tyisY Jul 04 10:16:38.227251 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Id: None Jul 04 10:16:38.227251 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Name: None Jul 04 10:16:38.227251 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 04 10:16:38.227251 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 04 10:16:38.227251 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 04 10:16:38.227251 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 04 10:16:38.227251 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Id: 10baff2f6e0a421d8050f69d97e6c7c1 Jul 04 10:16:38.227251 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Name: tempest-VolumesNegativeTest-691364777 Jul 04 10:16:38.227251 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Role: reader,member Jul 04 10:16:38.227251 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Roles: reader,member Jul 04 10:16:38.228951 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/10baff2f6e0a421d8050f69d97e6c7c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_10baff2f6e0a421d8050f69d97e6c7c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/10baff2f6e0a421d8050f69d97e6c7c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/10baff2f6e0a421d8050f69d97e6c7c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:16:38.228951 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant: tempest-VolumesNegativeTest-691364777 Jul 04 10:16:38.228951 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Id: 10baff2f6e0a421d8050f69d97e6c7c1 Jul 04 10:16:38.228951 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Name: tempest-VolumesNegativeTest-691364777 Jul 04 10:16:38.228951 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User: tempest-VolumesNegativeTest-691364777-project Jul 04 10:16:38.228951 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 04 10:16:38.228951 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 04 10:16:38.228951 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Id: 8f80d61cfbe949a7a55d565de30b63ba Jul 04 10:16:38.228951 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Name: tempest-VolumesNegativeTest-691364777-project Jul 04 10:16:38.228951 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: method: > Jul 04 10:16:38.228951 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: exception: Instance ffd80713-357e-41a4-8c07-866bb74d13a1 could not be found. Jul 04 10:16:38.228951 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: action_args: {'id': 'ffd80713-357e-41a4-8c07-866bb74d13a1'} Jul 04 10:16:38.233726 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:16:38.233726 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:16:38.233726 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:16:38.233726 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:16:38.233726 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:16:38.233726 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:16:38.233726 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:16:38.233726 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:16:38.233726 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:16:38.233726 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:16:38.233726 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffd80713-357e-41a4-8c07-866bb74d13a1 could not be found. Jul 04 10:16:38.233726 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:16:38.233726 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:16:38.233726 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:16:38.233726 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:16:38.233726 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:16:38.233726 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:16:38.233726 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:16:38.233726 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:16:38.233726 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:16:38.237708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:16:38.237708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 10:16:38.237708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 10:16:38.237708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:16:38.237708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:16:38.237708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:16:38.237708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:16:38.237708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffd80713-357e-41a4-8c07-866bb74d13a1 could not be found. Jul 04 10:16:38.237708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:16:38.237708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:16:38.237708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:16:38.237708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:16:38.237708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:16:38.237708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:16:38.237708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:16:38.237708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:16:38.237708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffd80713-357e-41a4-8c07-866bb74d13a1 could not be found. Jul 04 10:16:38.237708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:16:38.239509 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-7d7b43c2-dd13-4db1-87e3-3f059f747534 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] Returning 404 to user: Instance ffd80713-357e-41a4-8c07-866bb74d13a1 could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:16:38.239509 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-7d7b43c2-dd13-4db1-87e3-3f059f747534 tempest-VolumesNegativeTest-691364777 tempest-VolumesNegativeTest-691364777-project] 10.222.0.79 "GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1" status: 404 len: 111 microversion: 2.1 time: 0.034211 Jul 04 10:16:38.239509 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 450/902] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:38 2022] GET /compute/v2.1/servers/ffd80713-357e-41a4-8c07-866bb74d13a1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:16:38.263457 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-95a046f1-6c37-4228-9a26-e707100562c3 req-5bcb2f82-9c2d-49f6-924c-09ce1326ab49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2a1784f-42f6-4008-8876-e94fe9c5b2e5", "name": "network-vif-deleted", "tag": "3e85a0da-42ed-45c8-9f74-14b797540c24"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:16:38.272022 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-95a046f1-6c37-4228-9a26-e707100562c3 req-5bcb2f82-9c2d-49f6-924c-09ce1326ab49 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:38.272475 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-95a046f1-6c37-4228-9a26-e707100562c3 req-5bcb2f82-9c2d-49f6-924c-09ce1326ab49 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:38.283940 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-95a046f1-6c37-4228-9a26-e707100562c3 req-5bcb2f82-9c2d-49f6-924c-09ce1326ab49 service nova] Creating event network-vif-deleted:3e85a0da-42ed-45c8-9f74-14b797540c24 for instance d2a1784f-42f6-4008-8876-e94fe9c5b2e5 on hv-cinder-84841 Jul 04 10:16:38.288774 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-95a046f1-6c37-4228-9a26-e707100562c3 req-5bcb2f82-9c2d-49f6-924c-09ce1326ab49 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029010 Jul 04 10:16:38.289356 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 453/903] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:16:38.340947 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-66e4c6cf-2993-4666-bb92-392972c36276 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:38.341555 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-66e4c6cf-2993-4666-bb92-392972c36276 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: d2a1784f-42f6-4008-8876-e94fe9c5b2e5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:38.348540 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-66e4c6cf-2993-4666-bb92-392972c36276 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:38.349012 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-66e4c6cf-2993-4666-bb92-392972c36276 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:38.349810 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-66e4c6cf-2993-4666-bb92-392972c36276 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:38.350240 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-66e4c6cf-2993-4666-bb92-392972c36276 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:38.420450 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-66e4c6cf-2993-4666-bb92-392972c36276 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2495a8406c184164982d136edc351cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02795b95a9b84564999233883b763e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:16:38.429676 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-66e4c6cf-2993-4666-bb92-392972c36276 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5" status: 200 len: 1472 microversion: 2.1 time: 0.092880 Jul 04 10:16:38.431645 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 451/904] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:38 2022] GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5 => generated 1472 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:16:38.723045 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-cf482725-3e49-4ac6-8246-be6488ce9458 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:38.723735 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-cf482725-3e49-4ac6-8246-be6488ce9458 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] [instance: f9526d9a-e0e4-4708-a2da-872d57732128] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:38.730542 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-cf482725-3e49-4ac6-8246-be6488ce9458 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:38.731122 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-cf482725-3e49-4ac6-8246-be6488ce9458 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:38.731959 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-cf482725-3e49-4ac6-8246-be6488ce9458 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:38.732452 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-cf482725-3e49-4ac6-8246-be6488ce9458 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:38.747777 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.wsgi [None req-cf482725-3e49-4ac6-8246-be6488ce9458 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] HTTP exception thrown: Instance f9526d9a-e0e4-4708-a2da-872d57732128 could not be found. Jul 04 10:16:38.749506 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-cf482725-3e49-4ac6-8246-be6488ce9458 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Request method failure captured: Jul 04 10:16:38.749506 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: request: GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 HTTP/1.1 Jul 04 10:16:38.749506 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept: application/json Jul 04 10:16:38.749506 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept-Encoding: identity Jul 04 10:16:38.749506 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Connection: close Jul 04 10:16:38.749506 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Length: 0 Jul 04 10:16:38.749506 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Type: application/json Jul 04 10:16:38.749506 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Host: 10.222.0.79 Jul 04 10:16:38.749506 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Openstack-System-Scope: None Jul 04 10:16:38.749506 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: User-Agent: python-urllib3/1.26.9 Jul 04 10:16:38.749506 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Auth-Token: gAAAAABiwrzST4KJg4v4aJwccHFVKvP-R4maZGUR1C716VR_tt9R8ibvrRLY8mra7iG0ugKz0efSh2KHsJUBmRWTfmjny9PQTyM5oooAA30J7yQlaA23xd-XUFYKSt-wj7_Fzm6LAR82RrSZYZ5zaF4DTmnCfnZKtbQy-9-idvbPsMiGj7neEVY Jul 04 10:16:38.749506 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Id: None Jul 04 10:16:38.749506 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Name: None Jul 04 10:16:38.749506 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Identity-Status: Confirmed Jul 04 10:16:38.749506 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Is-Admin-Project: True Jul 04 10:16:38.749506 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Id: default Jul 04 10:16:38.749506 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Name: Default Jul 04 10:16:38.749506 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Id: f8d7bb97464d4807a6b7bbac9a41dc67 Jul 04 10:16:38.749506 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Name: tempest-TestShelveInstance-1013910931 Jul 04 10:16:38.749506 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Role: reader,member Jul 04 10:16:38.749506 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Roles: reader,member Jul 04 10:16:38.750856 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f8d7bb97464d4807a6b7bbac9a41dc67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f8d7bb97464d4807a6b7bbac9a41dc67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f8d7bb97464d4807a6b7bbac9a41dc67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f8d7bb97464d4807a6b7bbac9a41dc67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:16:38.750856 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant: tempest-TestShelveInstance-1013910931 Jul 04 10:16:38.750856 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Id: f8d7bb97464d4807a6b7bbac9a41dc67 Jul 04 10:16:38.750856 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Name: tempest-TestShelveInstance-1013910931 Jul 04 10:16:38.750856 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User: tempest-TestShelveInstance-1013910931-project Jul 04 10:16:38.750856 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Id: default Jul 04 10:16:38.750856 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Name: Default Jul 04 10:16:38.750856 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Id: f7c009e1bcd74151ad3fa95c68916329 Jul 04 10:16:38.750856 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Name: tempest-TestShelveInstance-1013910931-project Jul 04 10:16:38.750856 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: method: > Jul 04 10:16:38.750856 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: exception: Instance f9526d9a-e0e4-4708-a2da-872d57732128 could not be found. Jul 04 10:16:38.750856 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: action_args: {'id': 'f9526d9a-e0e4-4708-a2da-872d57732128'} Jul 04 10:16:38.751661 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:16:38.751661 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:16:38.751661 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:16:38.751661 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:16:38.751661 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:16:38.751661 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:16:38.751661 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:16:38.751661 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:16:38.751661 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:16:38.751661 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:16:38.751661 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9526d9a-e0e4-4708-a2da-872d57732128 could not be found. Jul 04 10:16:38.751661 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:16:38.751661 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:16:38.751661 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:16:38.751661 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:16:38.751661 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:16:38.751661 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:16:38.751661 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:16:38.751661 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:16:38.751661 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:16:38.752870 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:16:38.752870 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 10:16:38.752870 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 10:16:38.752870 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:16:38.752870 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:16:38.752870 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:16:38.752870 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:16:38.752870 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9526d9a-e0e4-4708-a2da-872d57732128 could not be found. Jul 04 10:16:38.752870 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:16:38.752870 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:16:38.752870 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:16:38.752870 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:16:38.752870 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:16:38.752870 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:16:38.752870 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:16:38.752870 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:16:38.752870 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9526d9a-e0e4-4708-a2da-872d57732128 could not be found. Jul 04 10:16:38.752870 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:16:38.754056 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-cf482725-3e49-4ac6-8246-be6488ce9458 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Returning 404 to user: Instance f9526d9a-e0e4-4708-a2da-872d57732128 could not be found. {{(pid=117866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:16:38.754056 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-cf482725-3e49-4ac6-8246-be6488ce9458 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128" status: 404 len: 111 microversion: 2.1 time: 0.032192 Jul 04 10:16:38.754056 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 454/905] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:38 2022] GET /compute/v2.1/servers/f9526d9a-e0e4-4708-a2da-872d57732128 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:16:39.132107 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-9c28f69e-befb-4fe3-8f5d-4390eef14222 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] Calling method '.version_select at 0x7f2802eb2820>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:39.182256 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-9c28f69e-befb-4fe3-8f5d-4390eef14222 tempest-TestShelveInstance-1013910931 tempest-TestShelveInstance-1013910931-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-794705669" status: 202 len: 0 microversion: 2.1 time: 0.053808 Jul 04 10:16:39.184181 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 452/906] 10.222.0.79 () {58 vars in 1250 bytes} [Mon Jul 4 10:16:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-794705669 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 10:16:39.447259 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-8f8b26f1-68c8-4093-9362-45cc5d7ff8a7 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:16:39.448683 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-8f8b26f1-68c8-4093-9362-45cc5d7ff8a7 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] [instance: d2a1784f-42f6-4008-8876-e94fe9c5b2e5] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:16:39.455497 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8f8b26f1-68c8-4093-9362-45cc5d7ff8a7 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:39.456248 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8f8b26f1-68c8-4093-9362-45cc5d7ff8a7 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:39.457247 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8f8b26f1-68c8-4093-9362-45cc5d7ff8a7 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:16:39.457695 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8f8b26f1-68c8-4093-9362-45cc5d7ff8a7 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:16:39.474087 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.wsgi [None req-8f8b26f1-68c8-4093-9362-45cc5d7ff8a7 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] HTTP exception thrown: Instance d2a1784f-42f6-4008-8876-e94fe9c5b2e5 could not be found. Jul 04 10:16:39.475932 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-8f8b26f1-68c8-4093-9362-45cc5d7ff8a7 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Request method failure captured: Jul 04 10:16:39.475932 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: request: GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5 HTTP/1.1 Jul 04 10:16:39.475932 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept: application/json Jul 04 10:16:39.475932 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept-Encoding: identity Jul 04 10:16:39.475932 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Connection: close Jul 04 10:16:39.475932 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Length: 0 Jul 04 10:16:39.475932 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Type: application/json Jul 04 10:16:39.475932 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Host: 10.222.0.79 Jul 04 10:16:39.475932 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Openstack-System-Scope: None Jul 04 10:16:39.475932 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: User-Agent: python-urllib3/1.26.9 Jul 04 10:16:39.475932 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Auth-Token: gAAAAABiwr2P9ZN0gzNrFdyUNTHGNwXrAIKsgIIvjus-99mnxsnQkw8brbeW-BwdVQBsFSMzlHLCt7n6rRGQ1XsCMDjMNtHqPHyg2W36lUZ3bG84anDyj7xht-Dvfl434IWNAzLAI5jV2OTl3OJ1euQIQqpTAtOEy5t9YA-MId8Vl2KaS6O-97A Jul 04 10:16:39.475932 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Id: None Jul 04 10:16:39.475932 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Name: None Jul 04 10:16:39.475932 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Identity-Status: Confirmed Jul 04 10:16:39.475932 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Is-Admin-Project: True Jul 04 10:16:39.475932 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Id: default Jul 04 10:16:39.475932 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Name: Default Jul 04 10:16:39.475932 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Id: 02795b95a9b84564999233883b763e4f Jul 04 10:16:39.475932 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Name: tempest-VolumesSnapshotTestJSON-520468413 Jul 04 10:16:39.475932 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Role: reader,member Jul 04 10:16:39.475932 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Roles: reader,member Jul 04 10:16:39.477293 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/02795b95a9b84564999233883b763e4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_02795b95a9b84564999233883b763e4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/02795b95a9b84564999233883b763e4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/02795b95a9b84564999233883b763e4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:16:39.477293 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant: tempest-VolumesSnapshotTestJSON-520468413 Jul 04 10:16:39.477293 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Id: 02795b95a9b84564999233883b763e4f Jul 04 10:16:39.477293 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-520468413 Jul 04 10:16:39.477293 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User: tempest-VolumesSnapshotTestJSON-520468413-project Jul 04 10:16:39.477293 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Id: default Jul 04 10:16:39.477293 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Name: Default Jul 04 10:16:39.477293 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Id: 2495a8406c184164982d136edc351cfd Jul 04 10:16:39.477293 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Name: tempest-VolumesSnapshotTestJSON-520468413-project Jul 04 10:16:39.477293 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: method: > Jul 04 10:16:39.477293 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: exception: Instance d2a1784f-42f6-4008-8876-e94fe9c5b2e5 could not be found. Jul 04 10:16:39.477293 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: action_args: {'id': 'd2a1784f-42f6-4008-8876-e94fe9c5b2e5'} Jul 04 10:16:39.478100 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:16:39.478100 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:16:39.478100 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:16:39.478100 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:16:39.478100 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:16:39.478100 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:16:39.478100 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:16:39.478100 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:16:39.478100 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:16:39.478100 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:16:39.478100 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2a1784f-42f6-4008-8876-e94fe9c5b2e5 could not be found. Jul 04 10:16:39.478100 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:16:39.478100 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:16:39.478100 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:16:39.478100 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:16:39.478100 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:16:39.478100 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:16:39.478100 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:16:39.478100 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:16:39.478100 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:16:39.479491 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:16:39.479491 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 10:16:39.479491 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 10:16:39.479491 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:16:39.479491 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:16:39.479491 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:16:39.479491 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:16:39.479491 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2a1784f-42f6-4008-8876-e94fe9c5b2e5 could not be found. Jul 04 10:16:39.479491 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:16:39.479491 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:16:39.479491 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:16:39.479491 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:16:39.479491 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:16:39.479491 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:16:39.479491 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:16:39.479491 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:16:39.479491 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2a1784f-42f6-4008-8876-e94fe9c5b2e5 could not be found. Jul 04 10:16:39.479491 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:16:39.482251 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-8f8b26f1-68c8-4093-9362-45cc5d7ff8a7 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] Returning 404 to user: Instance d2a1784f-42f6-4008-8876-e94fe9c5b2e5 could not be found. {{(pid=117866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:16:39.483104 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-8f8b26f1-68c8-4093-9362-45cc5d7ff8a7 tempest-VolumesSnapshotTestJSON-520468413 tempest-VolumesSnapshotTestJSON-520468413-project] 10.222.0.79 "GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5" status: 404 len: 111 microversion: 2.1 time: 0.039935 Jul 04 10:16:39.484515 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 455/907] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:16:39 2022] GET /compute/v2.1/servers/d2a1784f-42f6-4008-8876-e94fe9c5b2e5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:17:13.830028 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=33 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:17:13.830650 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:17:14.015570 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-688e7d9d-0297-4696-98de-6babdd528505 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Action: 'create', calling method: .version_select at 0x7f2802f88ee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1580130653", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWJbvPC0Zs/GTb9/wlRNnKCdGrkbcc89qizSocQ9xvGELzrCFtPyEcgeSewBDymHV8TFEcZtIGHnfibBJJSSLfTRfmSkG66jOj3P3zTxnc9eTOJAD6FB/cQhUZVKHaasg=="}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:17:14.031732 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-688e7d9d-0297-4696-98de-6babdd528505 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Getting quotas for project aaff1fa03a194074aa14fae9db94cefb. Resources: {'key_pairs'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 10:17:14.036354 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-688e7d9d-0297-4696-98de-6babdd528505 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Getting quotas for user 2321028b4d4f4734afd1ce674931a4d3 and project aaff1fa03a194074aa14fae9db94cefb. Resources: {'key_pairs'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 10:17:14.064401 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-688e7d9d-0297-4696-98de-6babdd528505 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.241588 Jul 04 10:17:14.065410 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 453/908] 10.222.0.79 () {60 vars in 1158 bytes} [Mon Jul 4 10:17:13 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:17:30.099344 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-f3f270ac-64b2-4f0d-9fe3-2f59cbbaa4f0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1980149364", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1580130653", "security_groups": [{"name": "tempest-secgroup-smoke-1337804478"}], "block_device_mapping_v2": [{"uuid": "2b53383f-9dbc-4bf2-893b-85ce938124b2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "28daa053-6dc3-4bbf-8b82-7f4c430042da"}]}} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:17:30.120911 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:17:30.121447 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell1:SELECT=47 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:17:30.384977 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.network.neutron [None req-f3f270ac-64b2-4f0d-9fe3-2f59cbbaa4f0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] validate_networks() for [('28daa053-6dc3-4bbf-8b82-7f4c430042da', None, None, None, None, None)] {{(pid=117866) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 10:17:30.995676 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-f3f270ac-64b2-4f0d-9fe3-2f59cbbaa4f0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Flavor limits 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 10:17:30.996098 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-f3f270ac-64b2-4f0d-9fe3-2f59cbbaa4f0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Image limits 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 10:17:30.996640 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-f3f270ac-64b2-4f0d-9fe3-2f59cbbaa4f0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Flavor pref 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 10:17:30.997039 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-f3f270ac-64b2-4f0d-9fe3-2f59cbbaa4f0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Image pref 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 10:17:30.997493 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-f3f270ac-64b2-4f0d-9fe3-2f59cbbaa4f0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 10:17:31.012088 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f3f270ac-64b2-4f0d-9fe3-2f59cbbaa4f0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:31.012544 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f3f270ac-64b2-4f0d-9fe3-2f59cbbaa4f0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:31.013314 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f3f270ac-64b2-4f0d-9fe3-2f59cbbaa4f0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:31.017810 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f3f270ac-64b2-4f0d-9fe3-2f59cbbaa4f0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:31.044034 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.quota [None req-f3f270ac-64b2-4f0d-9fe3-2f59cbbaa4f0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Getting quotas for project aaff1fa03a194074aa14fae9db94cefb. Resources: {'cores', 'ram', 'instances'} {{(pid=117866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 10:17:31.048124 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.quota [None req-f3f270ac-64b2-4f0d-9fe3-2f59cbbaa4f0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Getting quotas for user 2321028b4d4f4734afd1ce674931a4d3 and project aaff1fa03a194074aa14fae9db94cefb. Resources: {'cores', 'ram', 'instances'} {{(pid=117866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 10:17:31.138937 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-f3f270ac-64b2-4f0d-9fe3-2f59cbbaa4f0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Going to run 1 instances... {{(pid=117866) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 10:17:31.141017 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-f3f270ac-64b2-4f0d-9fe3-2f59cbbaa4f0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 0ab0336f-8710-421e-8d13-a3ca20ccdb6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2b53383f-9dbc-4bf2-893b-85ce938124b2',volume_size=None,volume_type=None)] {{(pid=117866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 10:17:31.331160 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-f3f270ac-64b2-4f0d-9fe3-2f59cbbaa4f0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.237721 Jul 04 10:17:31.332114 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 456/909] 10.222.0.79 () {60 vars in 1146 bytes} [Mon Jul 4 10:17:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 1239 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 10:17:31.340377 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=4 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:17:31.341883 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:17:31.349643 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2cf67319-fe65-4014-ae2c-722186143112 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:17:31.350734 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-2cf67319-fe65-4014-ae2c-722186143112 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 0ab0336f-8710-421e-8d13-a3ca20ccdb6a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:17:31.439784 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-2cf67319-fe65-4014-ae2c-722186143112 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:17:31.450170 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-2cf67319-fe65-4014-ae2c-722186143112 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a" status: 200 len: 1095 microversion: 2.1 time: 0.111279 Jul 04 10:17:31.460995 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 454/910] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:17:31 2022] GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a => generated 1095 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:17:32.468153 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-283337c7-b586-4154-b4aa-63a4712f6e07 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:17:32.469520 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-283337c7-b586-4154-b4aa-63a4712f6e07 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 0ab0336f-8710-421e-8d13-a3ca20ccdb6a] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:17:32.483179 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-283337c7-b586-4154-b4aa-63a4712f6e07 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:32.483632 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-283337c7-b586-4154-b4aa-63a4712f6e07 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:32.484424 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-283337c7-b586-4154-b4aa-63a4712f6e07 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:32.484941 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-283337c7-b586-4154-b4aa-63a4712f6e07 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:32.940182 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-283337c7-b586-4154-b4aa-63a4712f6e07 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:17:32.950630 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-283337c7-b586-4154-b4aa-63a4712f6e07 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a" status: 200 len: 1193 microversion: 2.1 time: 0.486729 Jul 04 10:17:32.968525 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 457/911] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:17:32 2022] GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a => generated 1193 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:17:33.969329 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f1166899-a24f-4b94-9e7b-3ab05880260e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:17:33.970563 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f1166899-a24f-4b94-9e7b-3ab05880260e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 0ab0336f-8710-421e-8d13-a3ca20ccdb6a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:17:33.996914 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f1166899-a24f-4b94-9e7b-3ab05880260e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:33.997660 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f1166899-a24f-4b94-9e7b-3ab05880260e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:34.001375 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f1166899-a24f-4b94-9e7b-3ab05880260e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:34.009234 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f1166899-a24f-4b94-9e7b-3ab05880260e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:34.331685 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-f1166899-a24f-4b94-9e7b-3ab05880260e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:17:34.354880 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f1166899-a24f-4b94-9e7b-3ab05880260e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a" status: 200 len: 1267 microversion: 2.1 time: 0.388265 Jul 04 10:17:34.357359 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 455/912] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:17:33 2022] GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a => generated 1267 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:17:35.211898 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-dbc81cbe-1fc8-4a9d-93ea-4ba5913b1e8a req-e85dde1b-33d8-4643-a3c0-8c24829f218f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ab0336f-8710-421e-8d13-a3ca20ccdb6a", "tag": "dd8a2307-84be-4a9e-b5e9-cadd43e51328"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:17:35.239450 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-dbc81cbe-1fc8-4a9d-93ea-4ba5913b1e8a req-e85dde1b-33d8-4643-a3c0-8c24829f218f service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:35.240103 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-dbc81cbe-1fc8-4a9d-93ea-4ba5913b1e8a req-e85dde1b-33d8-4643-a3c0-8c24829f218f service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:35.261608 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-dbc81cbe-1fc8-4a9d-93ea-4ba5913b1e8a req-e85dde1b-33d8-4643-a3c0-8c24829f218f service nova] Creating event network-changed:dd8a2307-84be-4a9e-b5e9-cadd43e51328 for instance 0ab0336f-8710-421e-8d13-a3ca20ccdb6a on hv-cinder-84841 Jul 04 10:17:35.267234 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-dbc81cbe-1fc8-4a9d-93ea-4ba5913b1e8a req-e85dde1b-33d8-4643-a3c0-8c24829f218f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064136 Jul 04 10:17:35.268266 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 458/913] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 10:17:35.379224 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-0fbe4c64-a775-462b-8f2a-1e1b8a54c5ae tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:17:35.380334 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-0fbe4c64-a775-462b-8f2a-1e1b8a54c5ae tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 0ab0336f-8710-421e-8d13-a3ca20ccdb6a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:17:35.391487 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0fbe4c64-a775-462b-8f2a-1e1b8a54c5ae tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:35.391992 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0fbe4c64-a775-462b-8f2a-1e1b8a54c5ae tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:35.392982 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0fbe4c64-a775-462b-8f2a-1e1b8a54c5ae tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:35.394127 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0fbe4c64-a775-462b-8f2a-1e1b8a54c5ae tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:35.736837 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-0fbe4c64-a775-462b-8f2a-1e1b8a54c5ae tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:17:35.749118 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-0fbe4c64-a775-462b-8f2a-1e1b8a54c5ae tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a" status: 200 len: 1267 microversion: 2.1 time: 0.376956 Jul 04 10:17:35.750576 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 456/914] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:17:35 2022] GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a => generated 1267 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:17:36.770744 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-4495500f-4509-4b2e-b329-317c33f0d889 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:17:36.772514 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-4495500f-4509-4b2e-b329-317c33f0d889 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 0ab0336f-8710-421e-8d13-a3ca20ccdb6a] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:17:36.781029 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-4495500f-4509-4b2e-b329-317c33f0d889 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:36.782113 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-4495500f-4509-4b2e-b329-317c33f0d889 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:36.783134 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-4495500f-4509-4b2e-b329-317c33f0d889 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:36.783782 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-4495500f-4509-4b2e-b329-317c33f0d889 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:37.150565 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-4495500f-4509-4b2e-b329-317c33f0d889 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:17:37.162680 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-4495500f-4509-4b2e-b329-317c33f0d889 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a" status: 200 len: 1267 microversion: 2.1 time: 0.398822 Jul 04 10:17:37.165104 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 459/915] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:17:36 2022] GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a => generated 1267 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:17:38.180241 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-82f36caa-ffd2-4875-b2d0-dfe8cf54b877 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:17:38.180844 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-82f36caa-ffd2-4875-b2d0-dfe8cf54b877 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 0ab0336f-8710-421e-8d13-a3ca20ccdb6a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:17:38.187434 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-82f36caa-ffd2-4875-b2d0-dfe8cf54b877 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:38.191159 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-82f36caa-ffd2-4875-b2d0-dfe8cf54b877 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:38.192222 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-82f36caa-ffd2-4875-b2d0-dfe8cf54b877 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:38.192898 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-82f36caa-ffd2-4875-b2d0-dfe8cf54b877 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:38.339263 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-82f36caa-ffd2-4875-b2d0-dfe8cf54b877 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:17:38.347049 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-82f36caa-ffd2-4875-b2d0-dfe8cf54b877 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a" status: 200 len: 1267 microversion: 2.1 time: 0.170925 Jul 04 10:17:38.347863 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 457/916] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:17:38 2022] GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:17:39.367704 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-03a45397-e063-46d8-b26c-ef182f3011dc tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:17:39.368369 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-03a45397-e063-46d8-b26c-ef182f3011dc tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 0ab0336f-8710-421e-8d13-a3ca20ccdb6a] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:17:39.383689 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-03a45397-e063-46d8-b26c-ef182f3011dc tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:39.384545 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-03a45397-e063-46d8-b26c-ef182f3011dc tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:39.386441 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-03a45397-e063-46d8-b26c-ef182f3011dc tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:39.387186 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-03a45397-e063-46d8-b26c-ef182f3011dc tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:39.570616 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-03a45397-e063-46d8-b26c-ef182f3011dc tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:17:39.578811 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-03a45397-e063-46d8-b26c-ef182f3011dc tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a" status: 200 len: 1267 microversion: 2.1 time: 0.217780 Jul 04 10:17:39.588462 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 460/917] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:17:39 2022] GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a => generated 1267 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:17:40.599423 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-393cdd51-5061-4f1e-8d26-f28f450b075f tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:17:40.600049 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-393cdd51-5061-4f1e-8d26-f28f450b075f tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 0ab0336f-8710-421e-8d13-a3ca20ccdb6a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:17:40.606832 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-393cdd51-5061-4f1e-8d26-f28f450b075f tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:40.608061 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-393cdd51-5061-4f1e-8d26-f28f450b075f tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:40.611827 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-393cdd51-5061-4f1e-8d26-f28f450b075f tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:40.612522 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-393cdd51-5061-4f1e-8d26-f28f450b075f tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:40.815389 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-393cdd51-5061-4f1e-8d26-f28f450b075f tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:17:40.826236 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-393cdd51-5061-4f1e-8d26-f28f450b075f tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a" status: 200 len: 1267 microversion: 2.1 time: 0.231348 Jul 04 10:17:40.827516 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 458/918] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:17:40 2022] GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a => generated 1267 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:17:41.843983 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-7e3c414c-3f06-4738-b996-c3fb73b71025 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:17:41.844575 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-7e3c414c-3f06-4738-b996-c3fb73b71025 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 0ab0336f-8710-421e-8d13-a3ca20ccdb6a] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:17:41.847142 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell0:SELECT=2 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:17:41.847946 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell0:SELECT=6 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:17:41.855222 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7e3c414c-3f06-4738-b996-c3fb73b71025 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:41.855687 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7e3c414c-3f06-4738-b996-c3fb73b71025 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:41.856444 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7e3c414c-3f06-4738-b996-c3fb73b71025 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:41.856864 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7e3c414c-3f06-4738-b996-c3fb73b71025 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:41.899645 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-62f6b2cf-f52f-49cc-b398-8c5f93f19409 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Action: 'create', calling method: .version_select at 0x7f2802ff33a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-999650392", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLF6SyD62GAbRlpe8vN9fL6acxf6r8ECmzgh2rSFZJn+0NPjVyKuPy1bMfZZjZRru9O+/kHIraXLP81ZgBTqMrbLy+OQuv44MHJjz8pSWpZXQ4qhpbZN5VBhNFY8CavoHA=="}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:17:41.903724 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:17:41.916490 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-62f6b2cf-f52f-49cc-b398-8c5f93f19409 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Getting quotas for project 09b54b24115e4074a79f93c255d4c0ca. Resources: {'key_pairs'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 10:17:41.920216 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-62f6b2cf-f52f-49cc-b398-8c5f93f19409 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Getting quotas for user 2264f97424ae45ffa5770a66e95897c7 and project 09b54b24115e4074a79f93c255d4c0ca. Resources: {'key_pairs'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 10:17:41.944208 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-62f6b2cf-f52f-49cc-b398-8c5f93f19409 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.048428 Jul 04 10:17:41.944811 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 459/919] 10.222.0.79 () {60 vars in 1158 bytes} [Mon Jul 4 10:17:41 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 10:17:41.996726 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-7e3c414c-3f06-4738-b996-c3fb73b71025 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:17:42.004623 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-7e3c414c-3f06-4738-b996-c3fb73b71025 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a" status: 200 len: 1267 microversion: 2.1 time: 0.164491 Jul 04 10:17:42.005288 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 461/920] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:17:41 2022] GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:17:42.046818 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-851a249e-3dc5-4a52-8c22-c79bfff9ff5b tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1144875807", "imageRef": "d31d7a49-7119-4510-8e4d-86e30c04c36f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-999650392", "networks": [{"uuid": "126ed554-ad68-449c-8b8d-0dccc8e656a8"}]}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:17:42.097661 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.network.neutron [None req-851a249e-3dc5-4a52-8c22-c79bfff9ff5b tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] validate_networks() for [('126ed554-ad68-449c-8b8d-0dccc8e656a8', None, None, None, None, None)] {{(pid=117865) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 10:17:42.503679 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-851a249e-3dc5-4a52-8c22-c79bfff9ff5b tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Flavor limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 10:17:42.504096 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-851a249e-3dc5-4a52-8c22-c79bfff9ff5b tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Image limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 10:17:42.504565 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-851a249e-3dc5-4a52-8c22-c79bfff9ff5b tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Flavor pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 10:17:42.504970 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-851a249e-3dc5-4a52-8c22-c79bfff9ff5b tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Image pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 10:17:42.505376 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-851a249e-3dc5-4a52-8c22-c79bfff9ff5b tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 10:17:42.515366 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-851a249e-3dc5-4a52-8c22-c79bfff9ff5b tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:42.515811 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-851a249e-3dc5-4a52-8c22-c79bfff9ff5b tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:42.516604 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-851a249e-3dc5-4a52-8c22-c79bfff9ff5b tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:42.517321 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-851a249e-3dc5-4a52-8c22-c79bfff9ff5b tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:42.533868 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-851a249e-3dc5-4a52-8c22-c79bfff9ff5b tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Getting quotas for project 09b54b24115e4074a79f93c255d4c0ca. Resources: {'cores', 'ram', 'instances'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 10:17:42.538327 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-851a249e-3dc5-4a52-8c22-c79bfff9ff5b tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Getting quotas for user 2264f97424ae45ffa5770a66e95897c7 and project 09b54b24115e4074a79f93c255d4c0ca. Resources: {'cores', 'ram', 'instances'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 10:17:42.550126 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-851a249e-3dc5-4a52-8c22-c79bfff9ff5b tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Going to run 1 instances... {{(pid=117865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 10:17:42.552312 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-851a249e-3dc5-4a52-8c22-c79bfff9ff5b tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d31d7a49-7119-4510-8e4d-86e30c04c36f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 10:17:42.598668 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-851a249e-3dc5-4a52-8c22-c79bfff9ff5b tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.555742 Jul 04 10:17:42.599320 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 460/921] 10.222.0.79 () {60 vars in 1146 bytes} [Mon Jul 4 10:17:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 10:17:42.609140 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-984c7529-5fd2-4222-ab05-57897799320a tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:17:42.609778 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-984c7529-5fd2-4222-ab05-57897799320a tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:17:42.663838 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-984c7529-5fd2-4222-ab05-57897799320a tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2264f97424ae45ffa5770a66e95897c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b54b24115e4074a79f93c255d4c0ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:17:42.670783 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-984c7529-5fd2-4222-ab05-57897799320a tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7" status: 200 len: 1258 microversion: 2.1 time: 0.065508 Jul 04 10:17:42.671358 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 462/922] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:17:42 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:17:43.022479 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-7f7fc0c1-2a06-4c5a-855f-a654c964e5ad tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:17:43.023134 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-7f7fc0c1-2a06-4c5a-855f-a654c964e5ad tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 0ab0336f-8710-421e-8d13-a3ca20ccdb6a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:17:43.029957 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7f7fc0c1-2a06-4c5a-855f-a654c964e5ad tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:43.030403 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7f7fc0c1-2a06-4c5a-855f-a654c964e5ad tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:43.031159 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7f7fc0c1-2a06-4c5a-855f-a654c964e5ad tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:43.031611 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7f7fc0c1-2a06-4c5a-855f-a654c964e5ad tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:43.178513 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-7f7fc0c1-2a06-4c5a-855f-a654c964e5ad tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:17:43.186079 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-7f7fc0c1-2a06-4c5a-855f-a654c964e5ad tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a" status: 200 len: 1267 microversion: 2.1 time: 0.168278 Jul 04 10:17:43.186664 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 461/923] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:17:43 2022] GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:17:43.688397 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-23493242-f2ee-41cf-9c98-0be00e1f5ee1 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:17:43.689009 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-23493242-f2ee-41cf-9c98-0be00e1f5ee1 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:17:43.698797 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-23493242-f2ee-41cf-9c98-0be00e1f5ee1 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:43.699262 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-23493242-f2ee-41cf-9c98-0be00e1f5ee1 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:43.700046 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-23493242-f2ee-41cf-9c98-0be00e1f5ee1 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:43.700483 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-23493242-f2ee-41cf-9c98-0be00e1f5ee1 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:43.772756 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-23493242-f2ee-41cf-9c98-0be00e1f5ee1 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2264f97424ae45ffa5770a66e95897c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b54b24115e4074a79f93c255d4c0ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:17:43.780476 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-23493242-f2ee-41cf-9c98-0be00e1f5ee1 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7" status: 200 len: 1316 microversion: 2.1 time: 0.096456 Jul 04 10:17:43.790920 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 463/924] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:17:43 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 => generated 1316 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:17:44.203455 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-35641225-dc80-4e3d-aff7-3d37a9e6c5cf tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:17:44.205131 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-35641225-dc80-4e3d-aff7-3d37a9e6c5cf tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 0ab0336f-8710-421e-8d13-a3ca20ccdb6a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:17:44.213372 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-35641225-dc80-4e3d-aff7-3d37a9e6c5cf tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:44.214781 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-35641225-dc80-4e3d-aff7-3d37a9e6c5cf tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:44.216278 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-35641225-dc80-4e3d-aff7-3d37a9e6c5cf tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:44.217118 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-35641225-dc80-4e3d-aff7-3d37a9e6c5cf tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:44.550343 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-35641225-dc80-4e3d-aff7-3d37a9e6c5cf tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:17:44.573839 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-35641225-dc80-4e3d-aff7-3d37a9e6c5cf tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a" status: 200 len: 1267 microversion: 2.1 time: 0.373951 Jul 04 10:17:44.590896 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 462/925] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:17:44 2022] GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a => generated 1267 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:17:44.799015 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-d2f4254b-f41d-4193-8bae-301807491f20 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:17:44.799772 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-d2f4254b-f41d-4193-8bae-301807491f20 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:17:44.809633 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d2f4254b-f41d-4193-8bae-301807491f20 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:44.811045 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d2f4254b-f41d-4193-8bae-301807491f20 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:44.812079 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d2f4254b-f41d-4193-8bae-301807491f20 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:44.812730 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d2f4254b-f41d-4193-8bae-301807491f20 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:45.137231 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-d2f4254b-f41d-4193-8bae-301807491f20 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2264f97424ae45ffa5770a66e95897c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b54b24115e4074a79f93c255d4c0ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:17:45.150391 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-d2f4254b-f41d-4193-8bae-301807491f20 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7" status: 200 len: 1358 microversion: 2.1 time: 0.353797 Jul 04 10:17:45.163692 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 464/926] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:17:44 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 => generated 1358 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:17:45.493575 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-a4291576-d8a1-442d-ad70-0b9575c472ea req-4be45ff5-252c-4e7f-ae48-5c53efb4564a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36470523-145c-4c32-8ae0-b1d263e1fcf7", "tag": "78867a1e-7223-41da-904b-a129d827366b"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:17:45.521319 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-a4291576-d8a1-442d-ad70-0b9575c472ea req-4be45ff5-252c-4e7f-ae48-5c53efb4564a service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:45.521788 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-a4291576-d8a1-442d-ad70-0b9575c472ea req-4be45ff5-252c-4e7f-ae48-5c53efb4564a service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:45.545969 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-a4291576-d8a1-442d-ad70-0b9575c472ea req-4be45ff5-252c-4e7f-ae48-5c53efb4564a service nova] Creating event network-changed:78867a1e-7223-41da-904b-a129d827366b for instance 36470523-145c-4c32-8ae0-b1d263e1fcf7 on hv-cinder-84841 Jul 04 10:17:45.553114 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-a4291576-d8a1-442d-ad70-0b9575c472ea req-4be45ff5-252c-4e7f-ae48-5c53efb4564a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062049 Jul 04 10:17:45.554828 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 463/927] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:17:45.592839 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-56372553-e3cd-4df1-a891-f86ce5b04f12 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:17:45.593733 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-56372553-e3cd-4df1-a891-f86ce5b04f12 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 0ab0336f-8710-421e-8d13-a3ca20ccdb6a] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:17:45.602452 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-56372553-e3cd-4df1-a891-f86ce5b04f12 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:45.603265 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-56372553-e3cd-4df1-a891-f86ce5b04f12 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:45.604204 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-56372553-e3cd-4df1-a891-f86ce5b04f12 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:45.605658 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-56372553-e3cd-4df1-a891-f86ce5b04f12 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:45.776493 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-56372553-e3cd-4df1-a891-f86ce5b04f12 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:17:45.785094 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-56372553-e3cd-4df1-a891-f86ce5b04f12 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a" status: 200 len: 1267 microversion: 2.1 time: 0.196294 Jul 04 10:17:45.786520 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 465/928] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:17:45 2022] GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:17:46.170387 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-1336faa6-589f-4e21-bc55-fe0c2f3cf077 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:17:46.171076 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-1336faa6-589f-4e21-bc55-fe0c2f3cf077 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:17:46.180003 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1336faa6-589f-4e21-bc55-fe0c2f3cf077 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:46.180838 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1336faa6-589f-4e21-bc55-fe0c2f3cf077 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:46.181946 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1336faa6-589f-4e21-bc55-fe0c2f3cf077 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:46.182564 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1336faa6-589f-4e21-bc55-fe0c2f3cf077 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:46.205709 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-d267e66b-4e18-495b-a189-da87f0881db7 req-654aefe6-85f4-469d-be4b-16e3710d1c95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ab0336f-8710-421e-8d13-a3ca20ccdb6a", "name": "network-vif-plugged", "status": "completed", "tag": "dd8a2307-84be-4a9e-b5e9-cadd43e51328"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:17:46.221832 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-d267e66b-4e18-495b-a189-da87f0881db7 req-654aefe6-85f4-469d-be4b-16e3710d1c95 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:46.222627 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-d267e66b-4e18-495b-a189-da87f0881db7 req-654aefe6-85f4-469d-be4b-16e3710d1c95 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:46.247070 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-d267e66b-4e18-495b-a189-da87f0881db7 req-654aefe6-85f4-469d-be4b-16e3710d1c95 service nova] Creating event network-vif-plugged:dd8a2307-84be-4a9e-b5e9-cadd43e51328 for instance 0ab0336f-8710-421e-8d13-a3ca20ccdb6a on hv-cinder-84841 Jul 04 10:17:46.255994 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-d267e66b-4e18-495b-a189-da87f0881db7 req-654aefe6-85f4-469d-be4b-16e3710d1c95 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053564 Jul 04 10:17:46.257168 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 466/929] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 10:17:46.344438 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-1336faa6-589f-4e21-bc55-fe0c2f3cf077 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2264f97424ae45ffa5770a66e95897c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b54b24115e4074a79f93c255d4c0ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:17:46.352404 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-1336faa6-589f-4e21-bc55-fe0c2f3cf077 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7" status: 200 len: 1358 microversion: 2.1 time: 0.186598 Jul 04 10:17:46.353220 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 464/930] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:17:46 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:17:46.805970 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-941ceef4-3317-4b76-a6c1-6799b40ca6c1 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:17:46.806953 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-941ceef4-3317-4b76-a6c1-6799b40ca6c1 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 0ab0336f-8710-421e-8d13-a3ca20ccdb6a] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:17:46.813923 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-941ceef4-3317-4b76-a6c1-6799b40ca6c1 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:46.814642 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-941ceef4-3317-4b76-a6c1-6799b40ca6c1 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:46.815575 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-941ceef4-3317-4b76-a6c1-6799b40ca6c1 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:46.816199 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-941ceef4-3317-4b76-a6c1-6799b40ca6c1 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:46.973855 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-941ceef4-3317-4b76-a6c1-6799b40ca6c1 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:17:46.982521 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-941ceef4-3317-4b76-a6c1-6799b40ca6c1 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a" status: 200 len: 1267 microversion: 2.1 time: 0.182164 Jul 04 10:17:46.983685 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 467/931] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:17:46 2022] GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:17:47.369844 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-abf88304-3eba-46e1-940e-85f16e9663ad tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:17:47.371184 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-abf88304-3eba-46e1-940e-85f16e9663ad tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:17:47.378228 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-abf88304-3eba-46e1-940e-85f16e9663ad tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:47.378833 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-abf88304-3eba-46e1-940e-85f16e9663ad tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:47.379980 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-abf88304-3eba-46e1-940e-85f16e9663ad tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:47.380417 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-abf88304-3eba-46e1-940e-85f16e9663ad tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:47.521982 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-abf88304-3eba-46e1-940e-85f16e9663ad tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2264f97424ae45ffa5770a66e95897c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b54b24115e4074a79f93c255d4c0ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:17:47.529918 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-abf88304-3eba-46e1-940e-85f16e9663ad tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7" status: 200 len: 1358 microversion: 2.1 time: 0.163948 Jul 04 10:17:47.534466 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 465/932] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:17:47 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:17:48.000475 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-92a20999-e9a0-46d7-84f8-cc27b00e302d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:17:48.001188 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-92a20999-e9a0-46d7-84f8-cc27b00e302d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 0ab0336f-8710-421e-8d13-a3ca20ccdb6a] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:17:48.008117 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-92a20999-e9a0-46d7-84f8-cc27b00e302d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:48.008553 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-92a20999-e9a0-46d7-84f8-cc27b00e302d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:48.009361 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-92a20999-e9a0-46d7-84f8-cc27b00e302d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:48.009883 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-92a20999-e9a0-46d7-84f8-cc27b00e302d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:48.160591 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-92a20999-e9a0-46d7-84f8-cc27b00e302d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:17:48.168297 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-92a20999-e9a0-46d7-84f8-cc27b00e302d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a" status: 200 len: 1267 microversion: 2.1 time: 0.171828 Jul 04 10:17:48.168853 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 468/933] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:17:47 2022] GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:17:48.547798 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-44c31a26-a903-48f0-9d18-9e64e21bc7b3 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:17:48.548512 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-44c31a26-a903-48f0-9d18-9e64e21bc7b3 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:17:48.555919 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-44c31a26-a903-48f0-9d18-9e64e21bc7b3 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:48.556752 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-44c31a26-a903-48f0-9d18-9e64e21bc7b3 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:48.557933 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-44c31a26-a903-48f0-9d18-9e64e21bc7b3 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:48.558587 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-44c31a26-a903-48f0-9d18-9e64e21bc7b3 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:48.693859 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-44c31a26-a903-48f0-9d18-9e64e21bc7b3 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2264f97424ae45ffa5770a66e95897c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b54b24115e4074a79f93c255d4c0ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:17:48.702449 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-44c31a26-a903-48f0-9d18-9e64e21bc7b3 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7" status: 200 len: 1358 microversion: 2.1 time: 0.158888 Jul 04 10:17:48.703309 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 466/934] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:17:48 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:17:49.184852 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-83c24644-cc2a-4383-a966-38b9c279a6c7 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:17:49.185484 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-83c24644-cc2a-4383-a966-38b9c279a6c7 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 0ab0336f-8710-421e-8d13-a3ca20ccdb6a] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:17:49.192302 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-83c24644-cc2a-4383-a966-38b9c279a6c7 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:49.192737 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-83c24644-cc2a-4383-a966-38b9c279a6c7 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:49.193490 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-83c24644-cc2a-4383-a966-38b9c279a6c7 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:49.193978 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-83c24644-cc2a-4383-a966-38b9c279a6c7 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:49.345113 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-83c24644-cc2a-4383-a966-38b9c279a6c7 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:17:49.354862 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-83c24644-cc2a-4383-a966-38b9c279a6c7 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a" status: 200 len: 1267 microversion: 2.1 time: 0.173758 Jul 04 10:17:49.356433 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 469/935] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:17:49 2022] GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:17:49.721325 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-cccb4440-39c7-406a-a38e-0ab23e1062b4 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:17:49.722303 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-cccb4440-39c7-406a-a38e-0ab23e1062b4 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:17:49.730648 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cccb4440-39c7-406a-a38e-0ab23e1062b4 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:49.731098 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cccb4440-39c7-406a-a38e-0ab23e1062b4 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:49.732040 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cccb4440-39c7-406a-a38e-0ab23e1062b4 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:49.732488 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cccb4440-39c7-406a-a38e-0ab23e1062b4 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:49.871921 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-cccb4440-39c7-406a-a38e-0ab23e1062b4 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2264f97424ae45ffa5770a66e95897c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b54b24115e4074a79f93c255d4c0ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:17:49.880758 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-cccb4440-39c7-406a-a38e-0ab23e1062b4 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7" status: 200 len: 1358 microversion: 2.1 time: 0.163633 Jul 04 10:17:49.881345 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 467/936] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:17:49 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:17:50.372632 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-04974a35-a7cf-4a3d-bc2d-4336e43ff31d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:17:50.373248 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-04974a35-a7cf-4a3d-bc2d-4336e43ff31d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 0ab0336f-8710-421e-8d13-a3ca20ccdb6a] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:17:50.391767 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-04974a35-a7cf-4a3d-bc2d-4336e43ff31d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:50.392142 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-04974a35-a7cf-4a3d-bc2d-4336e43ff31d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:50.392911 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-04974a35-a7cf-4a3d-bc2d-4336e43ff31d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:50.393338 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-04974a35-a7cf-4a3d-bc2d-4336e43ff31d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:50.536551 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-04974a35-a7cf-4a3d-bc2d-4336e43ff31d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:17:50.545597 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-04974a35-a7cf-4a3d-bc2d-4336e43ff31d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a" status: 200 len: 1267 microversion: 2.1 time: 0.176801 Jul 04 10:17:50.555460 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 470/937] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:17:50 2022] GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:17:50.899627 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-a7bf82e9-9ef9-4dae-ad1b-1c72e3b8bf15 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:17:50.900271 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-a7bf82e9-9ef9-4dae-ad1b-1c72e3b8bf15 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:17:50.910061 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a7bf82e9-9ef9-4dae-ad1b-1c72e3b8bf15 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:50.910505 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a7bf82e9-9ef9-4dae-ad1b-1c72e3b8bf15 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:50.911260 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a7bf82e9-9ef9-4dae-ad1b-1c72e3b8bf15 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:50.911689 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a7bf82e9-9ef9-4dae-ad1b-1c72e3b8bf15 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:51.053922 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-a7bf82e9-9ef9-4dae-ad1b-1c72e3b8bf15 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2264f97424ae45ffa5770a66e95897c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b54b24115e4074a79f93c255d4c0ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:17:51.061744 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-a7bf82e9-9ef9-4dae-ad1b-1c72e3b8bf15 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7" status: 200 len: 1358 microversion: 2.1 time: 0.168168 Jul 04 10:17:51.062286 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 468/938] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:17:50 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:17:51.563243 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-fc847396-751d-445c-bd8e-7c7e721e46b0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:17:51.563931 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-fc847396-751d-445c-bd8e-7c7e721e46b0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 0ab0336f-8710-421e-8d13-a3ca20ccdb6a] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:17:51.574706 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-fc847396-751d-445c-bd8e-7c7e721e46b0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:51.575378 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-fc847396-751d-445c-bd8e-7c7e721e46b0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:51.576607 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-fc847396-751d-445c-bd8e-7c7e721e46b0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:51.577292 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-fc847396-751d-445c-bd8e-7c7e721e46b0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:51.721465 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-fc847396-751d-445c-bd8e-7c7e721e46b0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:17:51.731724 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-fc847396-751d-445c-bd8e-7c7e721e46b0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a" status: 200 len: 1267 microversion: 2.1 time: 0.172298 Jul 04 10:17:51.732527 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 471/939] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:17:51 2022] GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:17:52.082966 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-1a48cbc0-3960-4761-aaf4-e36e07f8a05a tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:17:52.083695 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-1a48cbc0-3960-4761-aaf4-e36e07f8a05a tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:17:52.092111 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1a48cbc0-3960-4761-aaf4-e36e07f8a05a tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:52.092633 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1a48cbc0-3960-4761-aaf4-e36e07f8a05a tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:52.093521 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1a48cbc0-3960-4761-aaf4-e36e07f8a05a tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:52.094071 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1a48cbc0-3960-4761-aaf4-e36e07f8a05a tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:52.273524 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-1a48cbc0-3960-4761-aaf4-e36e07f8a05a tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2264f97424ae45ffa5770a66e95897c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b54b24115e4074a79f93c255d4c0ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:17:52.281203 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-1a48cbc0-3960-4761-aaf4-e36e07f8a05a tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7" status: 200 len: 1358 microversion: 2.1 time: 0.204450 Jul 04 10:17:52.281775 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 469/940] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:17:52 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:17:52.754790 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-2e215267-ddd2-4ab6-8464-43a023a8cb38 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:17:52.755395 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-2e215267-ddd2-4ab6-8464-43a023a8cb38 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 0ab0336f-8710-421e-8d13-a3ca20ccdb6a] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:17:52.757955 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell0:SELECT=2 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:17:52.763690 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2e215267-ddd2-4ab6-8464-43a023a8cb38 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:52.764132 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2e215267-ddd2-4ab6-8464-43a023a8cb38 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:52.764924 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2e215267-ddd2-4ab6-8464-43a023a8cb38 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:52.765352 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2e215267-ddd2-4ab6-8464-43a023a8cb38 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:52.934389 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-2e215267-ddd2-4ab6-8464-43a023a8cb38 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:17:52.943043 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-2e215267-ddd2-4ab6-8464-43a023a8cb38 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a" status: 200 len: 1267 microversion: 2.1 time: 0.192425 Jul 04 10:17:52.943608 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 472/941] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:17:52 2022] GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:17:53.298459 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-aedd4f99-4fd3-48aa-b9d7-725dea69a47f tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:17:53.299067 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-aedd4f99-4fd3-48aa-b9d7-725dea69a47f tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:17:53.301399 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:17:53.302452 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=10 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:17:53.309333 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aedd4f99-4fd3-48aa-b9d7-725dea69a47f tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:53.309808 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aedd4f99-4fd3-48aa-b9d7-725dea69a47f tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:53.310576 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aedd4f99-4fd3-48aa-b9d7-725dea69a47f tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:53.311000 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aedd4f99-4fd3-48aa-b9d7-725dea69a47f tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:53.450152 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-aedd4f99-4fd3-48aa-b9d7-725dea69a47f tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2264f97424ae45ffa5770a66e95897c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b54b24115e4074a79f93c255d4c0ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:17:53.458105 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-aedd4f99-4fd3-48aa-b9d7-725dea69a47f tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7" status: 200 len: 1358 microversion: 2.1 time: 0.163522 Jul 04 10:17:53.458681 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 470/942] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:17:53 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:17:53.963195 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-812d70aa-a0b8-40df-807e-3371f9f168f0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:17:53.963788 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-812d70aa-a0b8-40df-807e-3371f9f168f0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 0ab0336f-8710-421e-8d13-a3ca20ccdb6a] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:17:53.972658 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-812d70aa-a0b8-40df-807e-3371f9f168f0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:53.973295 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-812d70aa-a0b8-40df-807e-3371f9f168f0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:53.974267 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-812d70aa-a0b8-40df-807e-3371f9f168f0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:53.974791 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-812d70aa-a0b8-40df-807e-3371f9f168f0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:54.117824 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-812d70aa-a0b8-40df-807e-3371f9f168f0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:17:54.125676 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-812d70aa-a0b8-40df-807e-3371f9f168f0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a" status: 200 len: 1454 microversion: 2.1 time: 0.168832 Jul 04 10:17:54.126289 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 473/943] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:17:53 2022] GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a => generated 1454 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:17:54.142411 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2de3fa74-c968-49ff-93d6-99123735fd8d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:17:54.143040 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-2de3fa74-c968-49ff-93d6-99123735fd8d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 0ab0336f-8710-421e-8d13-a3ca20ccdb6a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:17:54.149598 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2de3fa74-c968-49ff-93d6-99123735fd8d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:54.150083 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2de3fa74-c968-49ff-93d6-99123735fd8d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:54.150833 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2de3fa74-c968-49ff-93d6-99123735fd8d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:54.151257 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2de3fa74-c968-49ff-93d6-99123735fd8d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:54.286534 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-2de3fa74-c968-49ff-93d6-99123735fd8d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:17:54.298373 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-2de3fa74-c968-49ff-93d6-99123735fd8d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a" status: 200 len: 1454 microversion: 2.1 time: 0.159481 Jul 04 10:17:54.299028 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 471/944] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:17:54 2022] GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:17:54.475736 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-84f9d0f1-aca8-4bed-86bb-c70b6722caed tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:17:54.476355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-84f9d0f1-aca8-4bed-86bb-c70b6722caed tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:17:54.482663 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-84f9d0f1-aca8-4bed-86bb-c70b6722caed tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:54.483354 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-84f9d0f1-aca8-4bed-86bb-c70b6722caed tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:54.484128 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-84f9d0f1-aca8-4bed-86bb-c70b6722caed tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:54.484538 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-84f9d0f1-aca8-4bed-86bb-c70b6722caed tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:54.619049 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-84f9d0f1-aca8-4bed-86bb-c70b6722caed tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2264f97424ae45ffa5770a66e95897c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b54b24115e4074a79f93c255d4c0ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:17:54.626812 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-84f9d0f1-aca8-4bed-86bb-c70b6722caed tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7" status: 200 len: 1358 microversion: 2.1 time: 0.155537 Jul 04 10:17:54.627386 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 474/945] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:17:54 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:17:55.644117 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-985a005f-b520-469a-9030-ad68d87eb6ba tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:17:55.644736 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-985a005f-b520-469a-9030-ad68d87eb6ba tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:17:55.651503 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-985a005f-b520-469a-9030-ad68d87eb6ba tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:55.651900 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-985a005f-b520-469a-9030-ad68d87eb6ba tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:55.652646 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-985a005f-b520-469a-9030-ad68d87eb6ba tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:55.653063 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-985a005f-b520-469a-9030-ad68d87eb6ba tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:55.783514 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-985a005f-b520-469a-9030-ad68d87eb6ba tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2264f97424ae45ffa5770a66e95897c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b54b24115e4074a79f93c255d4c0ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:17:55.791844 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-985a005f-b520-469a-9030-ad68d87eb6ba tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7" status: 200 len: 1358 microversion: 2.1 time: 0.151596 Jul 04 10:17:55.792422 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 472/946] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:17:55 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:17:56.075665 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-f6e273df-5cb1-4b92-b7ec-a64609d43967 req-abc51937-3fed-4145-8c09-de3ade2e5a3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ab0336f-8710-421e-8d13-a3ca20ccdb6a", "tag": "dd8a2307-84be-4a9e-b5e9-cadd43e51328"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:17:56.084393 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-f6e273df-5cb1-4b92-b7ec-a64609d43967 req-abc51937-3fed-4145-8c09-de3ade2e5a3c service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:56.085177 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-f6e273df-5cb1-4b92-b7ec-a64609d43967 req-abc51937-3fed-4145-8c09-de3ade2e5a3c service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:56.097454 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-f6e273df-5cb1-4b92-b7ec-a64609d43967 req-abc51937-3fed-4145-8c09-de3ade2e5a3c service nova] Creating event network-changed:dd8a2307-84be-4a9e-b5e9-cadd43e51328 for instance 0ab0336f-8710-421e-8d13-a3ca20ccdb6a on hv-cinder-84841 Jul 04 10:17:56.103228 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-f6e273df-5cb1-4b92-b7ec-a64609d43967 req-abc51937-3fed-4145-8c09-de3ade2e5a3c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031204 Jul 04 10:17:56.103815 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 475/947] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:17:56.818458 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-7ac3555c-ad83-4d87-82c6-d7de5a301118 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:17:56.819813 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-7ac3555c-ad83-4d87-82c6-d7de5a301118 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:17:56.837680 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7ac3555c-ad83-4d87-82c6-d7de5a301118 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:56.838151 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7ac3555c-ad83-4d87-82c6-d7de5a301118 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:56.838904 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7ac3555c-ad83-4d87-82c6-d7de5a301118 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:56.839344 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7ac3555c-ad83-4d87-82c6-d7de5a301118 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:57.003821 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-7ac3555c-ad83-4d87-82c6-d7de5a301118 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2264f97424ae45ffa5770a66e95897c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b54b24115e4074a79f93c255d4c0ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:17:57.008073 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=100 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:17:57.012851 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-7ac3555c-ad83-4d87-82c6-d7de5a301118 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7" status: 200 len: 1358 microversion: 2.1 time: 0.204481 Jul 04 10:17:57.013430 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 473/948] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:17:56 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:17:58.033692 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-7c15812d-3e1a-48c7-a66e-e6bd70a90160 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:17:58.034623 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-7c15812d-3e1a-48c7-a66e-e6bd70a90160 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:17:58.044110 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7c15812d-3e1a-48c7-a66e-e6bd70a90160 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:58.044703 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7c15812d-3e1a-48c7-a66e-e6bd70a90160 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:58.045714 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7c15812d-3e1a-48c7-a66e-e6bd70a90160 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:58.046327 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7c15812d-3e1a-48c7-a66e-e6bd70a90160 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:58.051727 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell1:SELECT=100 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:17:58.186116 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-7c15812d-3e1a-48c7-a66e-e6bd70a90160 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2264f97424ae45ffa5770a66e95897c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b54b24115e4074a79f93c255d4c0ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:17:58.194182 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-7c15812d-3e1a-48c7-a66e-e6bd70a90160 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7" status: 200 len: 1358 microversion: 2.1 time: 0.166857 Jul 04 10:17:58.194763 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 476/949] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:17:58 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:17:58.264406 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-4fed3cd6-ce06-4858-9cc2-1f1675f4b22e req-2b449625-7d35-4484-b199-e1cc3414994d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36470523-145c-4c32-8ae0-b1d263e1fcf7", "name": "network-vif-plugged", "status": "completed", "tag": "78867a1e-7223-41da-904b-a129d827366b"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:17:58.274265 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-4fed3cd6-ce06-4858-9cc2-1f1675f4b22e req-2b449625-7d35-4484-b199-e1cc3414994d service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:58.274736 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-4fed3cd6-ce06-4858-9cc2-1f1675f4b22e req-2b449625-7d35-4484-b199-e1cc3414994d service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:58.286348 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-4fed3cd6-ce06-4858-9cc2-1f1675f4b22e req-2b449625-7d35-4484-b199-e1cc3414994d service nova] Creating event network-vif-plugged:78867a1e-7223-41da-904b-a129d827366b for instance 36470523-145c-4c32-8ae0-b1d263e1fcf7 on hv-cinder-84841 Jul 04 10:17:58.291266 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-4fed3cd6-ce06-4858-9cc2-1f1675f4b22e req-2b449625-7d35-4484-b199-e1cc3414994d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031132 Jul 04 10:17:58.291974 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 474/950] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:17:59.216218 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-19bf5d9b-a596-437c-8537-f34dd5f80bb9 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:17:59.217206 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-19bf5d9b-a596-437c-8537-f34dd5f80bb9 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:17:59.227058 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-19bf5d9b-a596-437c-8537-f34dd5f80bb9 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:59.227504 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-19bf5d9b-a596-437c-8537-f34dd5f80bb9 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:59.228269 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-19bf5d9b-a596-437c-8537-f34dd5f80bb9 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:17:59.228694 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-19bf5d9b-a596-437c-8537-f34dd5f80bb9 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:17:59.634955 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-19bf5d9b-a596-437c-8537-f34dd5f80bb9 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2264f97424ae45ffa5770a66e95897c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b54b24115e4074a79f93c255d4c0ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:17:59.646369 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-19bf5d9b-a596-437c-8537-f34dd5f80bb9 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7" status: 200 len: 1358 microversion: 2.1 time: 0.436599 Jul 04 10:17:59.646967 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 477/951] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:17:59 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 => generated 1358 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:18:00.665708 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-73f4a9c1-0ab2-457e-89a8-445a0c8ee99c tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:18:00.666454 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-73f4a9c1-0ab2-457e-89a8-445a0c8ee99c tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:18:00.673231 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-73f4a9c1-0ab2-457e-89a8-445a0c8ee99c tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:00.673777 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-73f4a9c1-0ab2-457e-89a8-445a0c8ee99c tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:00.674552 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-73f4a9c1-0ab2-457e-89a8-445a0c8ee99c tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:00.674993 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-73f4a9c1-0ab2-457e-89a8-445a0c8ee99c tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:00.812850 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-73f4a9c1-0ab2-457e-89a8-445a0c8ee99c tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2264f97424ae45ffa5770a66e95897c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b54b24115e4074a79f93c255d4c0ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:18:00.820618 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-73f4a9c1-0ab2-457e-89a8-445a0c8ee99c tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7" status: 200 len: 1548 microversion: 2.1 time: 0.160883 Jul 04 10:18:00.821427 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 475/952] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:18:00 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:18:00.837899 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-389be6c9-e6c6-4721-80b6-c580e25542d1 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:18:00.838510 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-389be6c9-e6c6-4721-80b6-c580e25542d1 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:18:00.840900 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:18:00.846386 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-389be6c9-e6c6-4721-80b6-c580e25542d1 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:00.846838 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-389be6c9-e6c6-4721-80b6-c580e25542d1 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:00.847610 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-389be6c9-e6c6-4721-80b6-c580e25542d1 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:00.848064 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-389be6c9-e6c6-4721-80b6-c580e25542d1 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:00.986147 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-389be6c9-e6c6-4721-80b6-c580e25542d1 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2264f97424ae45ffa5770a66e95897c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b54b24115e4074a79f93c255d4c0ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:18:00.993929 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-389be6c9-e6c6-4721-80b6-c580e25542d1 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7" status: 200 len: 1548 microversion: 2.1 time: 0.160771 Jul 04 10:18:00.994459 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 478/953] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:18:00 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:18:01.011974 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-3838dc64-c53e-40d7-a339-6e6bd5cd6085 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:18:01.017117 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-3838dc64-c53e-40d7-a339-6e6bd5cd6085 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2264f97424ae45ffa5770a66e95897c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b54b24115e4074a79f93c255d4c0ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:18:01.018079 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-3838dc64-c53e-40d7-a339-6e6bd5cd6085 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Searching by: {'deleted': False, 'project_id': '09b54b24115e4074a79f93c255d4c0ca'} {{(pid=117865) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 04 10:18:01.026823 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3838dc64-c53e-40d7-a339-6e6bd5cd6085 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:01.027272 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3838dc64-c53e-40d7-a339-6e6bd5cd6085 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:01.028058 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3838dc64-c53e-40d7-a339-6e6bd5cd6085 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:01.028490 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3838dc64-c53e-40d7-a339-6e6bd5cd6085 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:01.118656 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.multi_cell_list [None req-3838dc64-c53e-40d7-a339-6e6bd5cd6085 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117865) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 04 10:18:01.211652 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-3838dc64-c53e-40d7-a339-6e6bd5cd6085 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.205084 Jul 04 10:18:01.212239 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 476/954] 10.222.0.79 () {58 vars in 1124 bytes} [Mon Jul 4 10:18:01 2022] GET /compute/v2.1/servers => generated 343 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:18:01.222746 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-16798aed-95f7-4c93-9ab2-0cd3f6336256 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:18:01.223359 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-16798aed-95f7-4c93-9ab2-0cd3f6336256 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:18:01.229657 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-16798aed-95f7-4c93-9ab2-0cd3f6336256 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:01.230137 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-16798aed-95f7-4c93-9ab2-0cd3f6336256 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:01.230896 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-16798aed-95f7-4c93-9ab2-0cd3f6336256 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:01.231325 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-16798aed-95f7-4c93-9ab2-0cd3f6336256 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:01.370511 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-16798aed-95f7-4c93-9ab2-0cd3f6336256 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2264f97424ae45ffa5770a66e95897c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b54b24115e4074a79f93c255d4c0ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:18:01.378142 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-16798aed-95f7-4c93-9ab2-0cd3f6336256 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7" status: 200 len: 1548 microversion: 2.1 time: 0.159298 Jul 04 10:18:01.378745 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 479/955] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:18:01 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:18:02.928094 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e3199210-9c71-411e-88b2-c124b3879185 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58b6f474-e7d1-4307-b007-a7e250113f1a"}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:18:02.929459 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-e3199210-9c71-411e-88b2-c124b3879185 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:18:02.933206 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=4 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:18:02.941662 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e3199210-9c71-411e-88b2-c124b3879185 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:02.942307 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e3199210-9c71-411e-88b2-c124b3879185 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:02.943539 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e3199210-9c71-411e-88b2-c124b3879185 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:02.944214 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e3199210-9c71-411e-88b2-c124b3879185 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:03.209552 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-e3199210-9c71-411e-88b2-c124b3879185 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "POST /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287850 Jul 04 10:18:03.210514 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 477/956] 10.222.0.79 () {60 vars in 1322 bytes} [Mon Jul 4 10:18:02 2022] POST /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:18:09.769293 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-7c7d6e1c-8fa6-4c41-9908-33bb5302a44a tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:18:09.769873 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-7c7d6e1c-8fa6-4c41-9908-33bb5302a44a tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:18:09.777186 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7c7d6e1c-8fa6-4c41-9908-33bb5302a44a tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:09.777647 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7c7d6e1c-8fa6-4c41-9908-33bb5302a44a tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:09.778424 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7c7d6e1c-8fa6-4c41-9908-33bb5302a44a tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:09.778853 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-7c7d6e1c-8fa6-4c41-9908-33bb5302a44a tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:09.922723 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-7c7d6e1c-8fa6-4c41-9908-33bb5302a44a tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2264f97424ae45ffa5770a66e95897c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b54b24115e4074a79f93c255d4c0ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:18:09.931169 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-7c7d6e1c-8fa6-4c41-9908-33bb5302a44a tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7" status: 200 len: 1594 microversion: 2.1 time: 0.165716 Jul 04 10:18:09.931709 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 480/957] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:18:09 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 => generated 1594 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:18:11.674409 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:18:11.680821 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-2bee4ae3-cab6-43cd-adac-2fa898e57ec0 req-fe491081-fccc-4845-abbc-6f50ddc122d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36470523-145c-4c32-8ae0-b1d263e1fcf7", "tag": "78867a1e-7223-41da-904b-a129d827366b"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:18:11.692235 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-2bee4ae3-cab6-43cd-adac-2fa898e57ec0 req-fe491081-fccc-4845-abbc-6f50ddc122d3 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:11.692917 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-2bee4ae3-cab6-43cd-adac-2fa898e57ec0 req-fe491081-fccc-4845-abbc-6f50ddc122d3 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:11.707377 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-2bee4ae3-cab6-43cd-adac-2fa898e57ec0 req-fe491081-fccc-4845-abbc-6f50ddc122d3 service nova] Creating event network-changed:78867a1e-7223-41da-904b-a129d827366b for instance 36470523-145c-4c32-8ae0-b1d263e1fcf7 on hv-cinder-84841 Jul 04 10:18:11.713548 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-2bee4ae3-cab6-43cd-adac-2fa898e57ec0 req-fe491081-fccc-4845-abbc-6f50ddc122d3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040449 Jul 04 10:18:11.714623 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 478/958] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:18:12.795008 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-8aacbe91-3338-47be-acd9-45668ec84392 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1330319293"}} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:18:12.795574 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-8aacbe91-3338-47be-acd9-45668ec84392 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:18:12.802310 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8aacbe91-3338-47be-acd9-45668ec84392 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:12.802753 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8aacbe91-3338-47be-acd9-45668ec84392 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:12.803527 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8aacbe91-3338-47be-acd9-45668ec84392 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:12.803948 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8aacbe91-3338-47be-acd9-45668ec84392 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:12.939996 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.network.security_group_api [None req-8aacbe91-3338-47be-acd9-45668ec84392 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Adding security group 628cbd7f-b7b5-46fa-89f5-d00afdb7aac4 to port 78867a1e-7223-41da-904b-a129d827366b Jul 04 10:18:13.306194 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-8aacbe91-3338-47be-acd9-45668ec84392 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "POST /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7/action" status: 202 len: 0 microversion: 2.1 time: 0.514982 Jul 04 10:18:13.306785 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 481/959] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Jul 4 10:18:12 2022] POST /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7/action => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 10:18:13.316497 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-4741ddc4-1c55-4d26-9630-eb44bd777fe9 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:18:13.318592 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-4741ddc4-1c55-4d26-9630-eb44bd777fe9 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:18:13.326149 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4741ddc4-1c55-4d26-9630-eb44bd777fe9 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:13.326465 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4741ddc4-1c55-4d26-9630-eb44bd777fe9 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:13.327236 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4741ddc4-1c55-4d26-9630-eb44bd777fe9 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:13.327668 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4741ddc4-1c55-4d26-9630-eb44bd777fe9 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:13.511639 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-4741ddc4-1c55-4d26-9630-eb44bd777fe9 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2264f97424ae45ffa5770a66e95897c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b54b24115e4074a79f93c255d4c0ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:18:13.519983 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-4741ddc4-1c55-4d26-9630-eb44bd777fe9 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7" status: 200 len: 1759 microversion: 2.1 time: 0.207724 Jul 04 10:18:13.520626 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 479/960] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:18:13 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 => generated 1759 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:18:13.729204 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-a78d0158-9f53-4c7c-b143-912f95e4bbd5 req-261ac72c-2c35-4bb1-8bc1-51ed4f3d5b54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36470523-145c-4c32-8ae0-b1d263e1fcf7", "tag": "78867a1e-7223-41da-904b-a129d827366b"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:18:13.738853 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-a78d0158-9f53-4c7c-b143-912f95e4bbd5 req-261ac72c-2c35-4bb1-8bc1-51ed4f3d5b54 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:13.739292 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-a78d0158-9f53-4c7c-b143-912f95e4bbd5 req-261ac72c-2c35-4bb1-8bc1-51ed4f3d5b54 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:13.750993 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-a78d0158-9f53-4c7c-b143-912f95e4bbd5 req-261ac72c-2c35-4bb1-8bc1-51ed4f3d5b54 service nova] Creating event network-changed:78867a1e-7223-41da-904b-a129d827366b for instance 36470523-145c-4c32-8ae0-b1d263e1fcf7 on hv-cinder-84841 Jul 04 10:18:13.755889 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-a78d0158-9f53-4c7c-b143-912f95e4bbd5 req-261ac72c-2c35-4bb1-8bc1-51ed4f3d5b54 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030411 Jul 04 10:18:13.756683 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 482/961] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:18:36.951762 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=5 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:18:36.952799 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:18:36.958817 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-76ebd5ce-8b91-412f-8ce4-4a1eeebd7016 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:18:36.960198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-76ebd5ce-8b91-412f-8ce4-4a1eeebd7016 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:18:36.967927 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-76ebd5ce-8b91-412f-8ce4-4a1eeebd7016 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:36.968401 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-76ebd5ce-8b91-412f-8ce4-4a1eeebd7016 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:36.969314 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-76ebd5ce-8b91-412f-8ce4-4a1eeebd7016 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:36.969801 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-76ebd5ce-8b91-412f-8ce4-4a1eeebd7016 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:37.052255 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-76ebd5ce-8b91-412f-8ce4-4a1eeebd7016 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "POST /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7/action" status: 202 len: 0 microversion: 2.1 time: 0.102713 Jul 04 10:18:37.055902 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 480/962] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Jul 4 10:18:36 2022] POST /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 10:18:37.059368 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_api:SELECT=9 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:18:37.060102 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell1:SELECT=34 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:18:37.064107 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-e281660d-bc8d-40fb-b733-ff095e46d3ce tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:18:37.064796 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-e281660d-bc8d-40fb-b733-ff095e46d3ce tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:18:37.071880 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e281660d-bc8d-40fb-b733-ff095e46d3ce tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:37.072316 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e281660d-bc8d-40fb-b733-ff095e46d3ce tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:37.073072 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e281660d-bc8d-40fb-b733-ff095e46d3ce tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:37.073499 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-e281660d-bc8d-40fb-b733-ff095e46d3ce tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:37.434106 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-e281660d-bc8d-40fb-b733-ff095e46d3ce tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2264f97424ae45ffa5770a66e95897c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b54b24115e4074a79f93c255d4c0ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:18:37.443826 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-e281660d-bc8d-40fb-b733-ff095e46d3ce tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7" status: 200 len: 1751 microversion: 2.1 time: 0.386165 Jul 04 10:18:37.444407 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 483/963] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:18:37 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 => generated 1751 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:18:38.470667 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-ebcbd4f7-9334-4ba3-9892-32b7140e536c tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:18:38.471677 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-ebcbd4f7-9334-4ba3-9892-32b7140e536c tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:18:38.478951 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ebcbd4f7-9334-4ba3-9892-32b7140e536c tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:38.479386 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ebcbd4f7-9334-4ba3-9892-32b7140e536c tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:38.480138 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ebcbd4f7-9334-4ba3-9892-32b7140e536c tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:38.480564 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ebcbd4f7-9334-4ba3-9892-32b7140e536c tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:38.746081 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-ebcbd4f7-9334-4ba3-9892-32b7140e536c tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2264f97424ae45ffa5770a66e95897c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b54b24115e4074a79f93c255d4c0ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:18:38.755874 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-ebcbd4f7-9334-4ba3-9892-32b7140e536c tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7" status: 200 len: 1756 microversion: 2.1 time: 0.292919 Jul 04 10:18:38.759820 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 481/964] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:18:38 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 => generated 1756 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:18:39.776916 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-397dfe9e-7f18-4dc5-ac5b-0fe47e470cc1 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:18:39.777670 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-397dfe9e-7f18-4dc5-ac5b-0fe47e470cc1 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:18:39.786188 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-397dfe9e-7f18-4dc5-ac5b-0fe47e470cc1 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:39.787006 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-397dfe9e-7f18-4dc5-ac5b-0fe47e470cc1 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:39.787805 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-397dfe9e-7f18-4dc5-ac5b-0fe47e470cc1 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:39.788398 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-397dfe9e-7f18-4dc5-ac5b-0fe47e470cc1 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:39.945954 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-397dfe9e-7f18-4dc5-ac5b-0fe47e470cc1 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2264f97424ae45ffa5770a66e95897c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b54b24115e4074a79f93c255d4c0ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:18:39.954237 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-397dfe9e-7f18-4dc5-ac5b-0fe47e470cc1 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7" status: 200 len: 1756 microversion: 2.1 time: 0.182230 Jul 04 10:18:39.954829 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 484/965] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:18:39 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:18:40.975199 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-4fe14939-acea-4103-9266-a255457ccb29 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:18:40.975789 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-4fe14939-acea-4103-9266-a255457ccb29 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:18:40.982566 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4fe14939-acea-4103-9266-a255457ccb29 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:40.983006 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4fe14939-acea-4103-9266-a255457ccb29 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:40.983748 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4fe14939-acea-4103-9266-a255457ccb29 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:40.984169 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4fe14939-acea-4103-9266-a255457ccb29 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:41.136720 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-4fe14939-acea-4103-9266-a255457ccb29 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2264f97424ae45ffa5770a66e95897c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b54b24115e4074a79f93c255d4c0ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:18:41.147976 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-4fe14939-acea-4103-9266-a255457ccb29 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7" status: 200 len: 1756 microversion: 2.1 time: 0.179027 Jul 04 10:18:41.148548 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 482/966] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:18:40 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:18:42.171304 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-83ce6b00-c3aa-4940-94f7-90973a03b6e6 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:18:42.171930 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-83ce6b00-c3aa-4940-94f7-90973a03b6e6 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:18:42.179699 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-83ce6b00-c3aa-4940-94f7-90973a03b6e6 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:42.180185 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-83ce6b00-c3aa-4940-94f7-90973a03b6e6 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:42.181066 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-83ce6b00-c3aa-4940-94f7-90973a03b6e6 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:42.181561 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-83ce6b00-c3aa-4940-94f7-90973a03b6e6 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:42.327008 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-83ce6b00-c3aa-4940-94f7-90973a03b6e6 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2264f97424ae45ffa5770a66e95897c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b54b24115e4074a79f93c255d4c0ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:18:42.335825 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-83ce6b00-c3aa-4940-94f7-90973a03b6e6 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7" status: 200 len: 1756 microversion: 2.1 time: 0.169227 Jul 04 10:18:42.336396 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 485/967] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:18:42 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:18:43.356780 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-6311858a-f11c-49c5-815d-da2428d150a1 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:18:43.357735 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-6311858a-f11c-49c5-815d-da2428d150a1 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:18:43.367413 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6311858a-f11c-49c5-815d-da2428d150a1 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:43.367856 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6311858a-f11c-49c5-815d-da2428d150a1 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:43.368606 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6311858a-f11c-49c5-815d-da2428d150a1 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:43.369033 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6311858a-f11c-49c5-815d-da2428d150a1 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:43.529673 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-6311858a-f11c-49c5-815d-da2428d150a1 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2264f97424ae45ffa5770a66e95897c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b54b24115e4074a79f93c255d4c0ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:18:43.542679 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-6311858a-f11c-49c5-815d-da2428d150a1 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7" status: 200 len: 1756 microversion: 2.1 time: 0.192036 Jul 04 10:18:43.543443 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 483/968] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:18:43 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 => generated 1756 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:18:44.567755 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-8c517a0d-ab7b-41f2-bbe2-9cf44e8d4edb tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:18:44.569081 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-8c517a0d-ab7b-41f2-bbe2-9cf44e8d4edb tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:18:44.576012 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8c517a0d-ab7b-41f2-bbe2-9cf44e8d4edb tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:44.576477 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8c517a0d-ab7b-41f2-bbe2-9cf44e8d4edb tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:44.577265 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8c517a0d-ab7b-41f2-bbe2-9cf44e8d4edb tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:44.577747 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8c517a0d-ab7b-41f2-bbe2-9cf44e8d4edb tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:44.733963 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-8c517a0d-ab7b-41f2-bbe2-9cf44e8d4edb tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2264f97424ae45ffa5770a66e95897c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b54b24115e4074a79f93c255d4c0ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:18:44.746199 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-8c517a0d-ab7b-41f2-bbe2-9cf44e8d4edb tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7" status: 200 len: 1756 microversion: 2.1 time: 0.184682 Jul 04 10:18:44.746941 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 486/969] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:18:44 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:18:45.770839 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-732b44f0-a282-4a93-90d8-671e8142750f tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:18:45.772659 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-732b44f0-a282-4a93-90d8-671e8142750f tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:18:45.779999 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-732b44f0-a282-4a93-90d8-671e8142750f tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:45.780467 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-732b44f0-a282-4a93-90d8-671e8142750f tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:45.781272 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-732b44f0-a282-4a93-90d8-671e8142750f tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:45.781766 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-732b44f0-a282-4a93-90d8-671e8142750f tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:45.933567 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-732b44f0-a282-4a93-90d8-671e8142750f tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2264f97424ae45ffa5770a66e95897c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b54b24115e4074a79f93c255d4c0ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:18:45.945286 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-732b44f0-a282-4a93-90d8-671e8142750f tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7" status: 200 len: 1756 microversion: 2.1 time: 0.181000 Jul 04 10:18:45.945885 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 484/970] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:18:45 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:18:46.965120 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-96b48ce0-08b6-49dd-b19b-bd394af88821 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:18:46.965735 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-96b48ce0-08b6-49dd-b19b-bd394af88821 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:18:46.972711 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-96b48ce0-08b6-49dd-b19b-bd394af88821 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:46.973156 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-96b48ce0-08b6-49dd-b19b-bd394af88821 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:46.973958 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-96b48ce0-08b6-49dd-b19b-bd394af88821 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:46.974382 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-96b48ce0-08b6-49dd-b19b-bd394af88821 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:47.122561 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-96b48ce0-08b6-49dd-b19b-bd394af88821 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2264f97424ae45ffa5770a66e95897c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b54b24115e4074a79f93c255d4c0ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:18:47.131001 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-96b48ce0-08b6-49dd-b19b-bd394af88821 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7" status: 200 len: 1756 microversion: 2.1 time: 0.170430 Jul 04 10:18:47.131538 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 487/971] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:18:46 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:18:48.152570 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2a140258-659d-4359-a36d-1f473e14ec13 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:18:48.153181 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-2a140258-659d-4359-a36d-1f473e14ec13 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:18:48.160510 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2a140258-659d-4359-a36d-1f473e14ec13 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:48.160959 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2a140258-659d-4359-a36d-1f473e14ec13 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:48.161760 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2a140258-659d-4359-a36d-1f473e14ec13 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:48.162189 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2a140258-659d-4359-a36d-1f473e14ec13 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:48.314037 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-2a140258-659d-4359-a36d-1f473e14ec13 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2264f97424ae45ffa5770a66e95897c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b54b24115e4074a79f93c255d4c0ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:18:48.323258 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-2a140258-659d-4359-a36d-1f473e14ec13 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7" status: 200 len: 1756 microversion: 2.1 time: 0.175071 Jul 04 10:18:48.323830 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 485/972] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:18:48 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:18:49.342274 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-865597b3-edb3-4291-9660-e8344153d495 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:18:49.342969 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-865597b3-edb3-4291-9660-e8344153d495 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:18:49.349573 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-865597b3-edb3-4291-9660-e8344153d495 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:49.350033 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-865597b3-edb3-4291-9660-e8344153d495 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:49.350777 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-865597b3-edb3-4291-9660-e8344153d495 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:18:49.351202 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-865597b3-edb3-4291-9660-e8344153d495 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:18:49.498472 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-865597b3-edb3-4291-9660-e8344153d495 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2264f97424ae45ffa5770a66e95897c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b54b24115e4074a79f93c255d4c0ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:18:49.507475 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-865597b3-edb3-4291-9660-e8344153d495 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7" status: 200 len: 1759 microversion: 2.1 time: 0.169697 Jul 04 10:18:49.508032 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 488/973] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:18:49 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 => generated 1759 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:19:21.799680 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-c9267668-d6fd-45b3-8a03-fd37dbaefa5d tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1330319293"}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:19:21.800744 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-c9267668-d6fd-45b3-8a03-fd37dbaefa5d tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:19:21.804063 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=12 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:19:21.804729 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:19:21.810594 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c9267668-d6fd-45b3-8a03-fd37dbaefa5d tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:21.811037 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c9267668-d6fd-45b3-8a03-fd37dbaefa5d tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:21.811798 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c9267668-d6fd-45b3-8a03-fd37dbaefa5d tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:21.812242 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c9267668-d6fd-45b3-8a03-fd37dbaefa5d tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:21.950515 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.network.security_group_api [None req-c9267668-d6fd-45b3-8a03-fd37dbaefa5d tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Removing security group 628cbd7f-b7b5-46fa-89f5-d00afdb7aac4 from port 78867a1e-7223-41da-904b-a129d827366b Jul 04 10:19:22.341514 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-c9267668-d6fd-45b3-8a03-fd37dbaefa5d tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "POST /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7/action" status: 202 len: 0 microversion: 2.1 time: 0.548748 Jul 04 10:19:22.345208 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 486/974] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Jul 4 10:19:21 2022] POST /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7/action => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 10:19:22.349902 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_api:SELECT=12 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:19:22.351204 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell1:SELECT=36 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:19:22.356388 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-2bbfbd9e-4bcd-4b78-8fd5-0c36c1adf90a req-e1ff4a29-7d12-4edf-a5e5-2780d34790fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36470523-145c-4c32-8ae0-b1d263e1fcf7", "tag": "78867a1e-7223-41da-904b-a129d827366b"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:19:22.371981 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-2bbfbd9e-4bcd-4b78-8fd5-0c36c1adf90a req-e1ff4a29-7d12-4edf-a5e5-2780d34790fc service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:22.372838 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-2bbfbd9e-4bcd-4b78-8fd5-0c36c1adf90a req-e1ff4a29-7d12-4edf-a5e5-2780d34790fc service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:22.390692 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-2bbfbd9e-4bcd-4b78-8fd5-0c36c1adf90a req-e1ff4a29-7d12-4edf-a5e5-2780d34790fc service nova] Creating event network-changed:78867a1e-7223-41da-904b-a129d827366b for instance 36470523-145c-4c32-8ae0-b1d263e1fcf7 on hv-cinder-84841 Jul 04 10:19:22.396953 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-2bbfbd9e-4bcd-4b78-8fd5-0c36c1adf90a req-e1ff4a29-7d12-4edf-a5e5-2780d34790fc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049040 Jul 04 10:19:22.399076 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 489/975] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:19:23.782942 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-bfebf608-2dc2-43aa-b7b8-0ca7897eeb1c tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:19:23.783483 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-bfebf608-2dc2-43aa-b7b8-0ca7897eeb1c tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:19:23.785072 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-770ffa72-31f9-4267-85e5-fcc14bf97f66 req-9b36f87c-c025-4950-84b1-efe76a312adf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36470523-145c-4c32-8ae0-b1d263e1fcf7", "tag": "78867a1e-7223-41da-904b-a129d827366b"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:19:23.790074 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bfebf608-2dc2-43aa-b7b8-0ca7897eeb1c tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:23.790537 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bfebf608-2dc2-43aa-b7b8-0ca7897eeb1c tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:23.791298 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bfebf608-2dc2-43aa-b7b8-0ca7897eeb1c tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:23.791977 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bfebf608-2dc2-43aa-b7b8-0ca7897eeb1c tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:23.795654 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-770ffa72-31f9-4267-85e5-fcc14bf97f66 req-9b36f87c-c025-4950-84b1-efe76a312adf service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:23.796138 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-770ffa72-31f9-4267-85e5-fcc14bf97f66 req-9b36f87c-c025-4950-84b1-efe76a312adf service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:23.808461 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-770ffa72-31f9-4267-85e5-fcc14bf97f66 req-9b36f87c-c025-4950-84b1-efe76a312adf service nova] Creating event network-changed:78867a1e-7223-41da-904b-a129d827366b for instance 36470523-145c-4c32-8ae0-b1d263e1fcf7 on hv-cinder-84841 Jul 04 10:19:23.813828 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-770ffa72-31f9-4267-85e5-fcc14bf97f66 req-9b36f87c-c025-4950-84b1-efe76a312adf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032852 Jul 04 10:19:23.814524 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 490/976] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:19:23.885393 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.objects.instance [None req-bfebf608-2dc2-43aa-b7b8-0ca7897eeb1c tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lazy-loading 'services' on Instance uuid 36470523-145c-4c32-8ae0-b1d263e1fcf7 {{(pid=117865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 10:19:23.965312 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-bfebf608-2dc2-43aa-b7b8-0ca7897eeb1c tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "DELETE /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7/os-volume_attachments/58b6f474-e7d1-4307-b007-a7e250113f1a" status: 202 len: 0 microversion: 2.1 time: 0.187083 Jul 04 10:19:23.966291 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 487/977] 10.222.0.79 () {58 vars in 1415 bytes} [Mon Jul 4 10:19:23 2022] DELETE /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7/os-volume_attachments/58b6f474-e7d1-4307-b007-a7e250113f1a => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 10:19:23.977806 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-207f6fdc-64cd-4e6d-8b52-c82514911c4b tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:19:23.979246 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-207f6fdc-64cd-4e6d-8b52-c82514911c4b tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:19:23.988336 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-207f6fdc-64cd-4e6d-8b52-c82514911c4b tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:23.989258 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-207f6fdc-64cd-4e6d-8b52-c82514911c4b tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:23.990059 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-207f6fdc-64cd-4e6d-8b52-c82514911c4b tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:23.990674 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-207f6fdc-64cd-4e6d-8b52-c82514911c4b tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:24.027347 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-207f6fdc-64cd-4e6d-8b52-c82514911c4b tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056180 Jul 04 10:19:24.027987 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 491/978] 10.222.0.79 () {58 vars in 1301 bytes} [Mon Jul 4 10:19:23 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:19:25.041363 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8217c7b3-70ba-4b86-a2df-be42ff82b8cb tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:19:25.042450 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-8217c7b3-70ba-4b86-a2df-be42ff82b8cb tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:19:25.049948 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8217c7b3-70ba-4b86-a2df-be42ff82b8cb tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:25.050389 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8217c7b3-70ba-4b86-a2df-be42ff82b8cb tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:25.051134 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8217c7b3-70ba-4b86-a2df-be42ff82b8cb tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:25.051552 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8217c7b3-70ba-4b86-a2df-be42ff82b8cb tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:25.083544 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-8217c7b3-70ba-4b86-a2df-be42ff82b8cb tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047200 Jul 04 10:19:25.084499 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 488/979] 10.222.0.79 () {58 vars in 1301 bytes} [Mon Jul 4 10:19:25 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 10:19:25.095920 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-f9a70d71-9423-421f-a2f4-a32aa33eb4d5 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:19:25.096685 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-f9a70d71-9423-421f-a2f4-a32aa33eb4d5 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:19:25.103351 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f9a70d71-9423-421f-a2f4-a32aa33eb4d5 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:25.103850 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f9a70d71-9423-421f-a2f4-a32aa33eb4d5 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:25.104608 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f9a70d71-9423-421f-a2f4-a32aa33eb4d5 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:25.105008 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-f9a70d71-9423-421f-a2f4-a32aa33eb4d5 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:25.201345 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.wsgi [None req-f9a70d71-9423-421f-a2f4-a32aa33eb4d5 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] HTTP exception thrown: Instance 36470523-145c-4c32-8ae0-b1d263e1fcf7 is not attached to volume 58b6f474-e7d1-4307-b007-a7e250113f1a Jul 04 10:19:25.205061 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-f9a70d71-9423-421f-a2f4-a32aa33eb4d5 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Request method failure captured: Jul 04 10:19:25.205061 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: request: DELETE /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7/os-volume_attachments/58b6f474-e7d1-4307-b007-a7e250113f1a HTTP/1.1 Jul 04 10:19:25.205061 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept: application/json Jul 04 10:19:25.205061 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept-Encoding: identity Jul 04 10:19:25.205061 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Connection: close Jul 04 10:19:25.205061 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Length: 0 Jul 04 10:19:25.205061 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Type: application/json Jul 04 10:19:25.205061 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Host: 10.222.0.79 Jul 04 10:19:25.205061 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Openstack-System-Scope: None Jul 04 10:19:25.205061 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: User-Agent: python-urllib3/1.26.9 Jul 04 10:19:25.205061 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Auth-Token: gAAAAABiwr40anM559mMGaCineQDs6ec65McHM9-81lnLU5BO1K5XZ-sV29-pNMa1mqa6pqH5Cc-tjDSw22ih25Ee3-W2ztPyyVp2l19pVW7TR6uYO9CBRYUAZFUzLxJ3iPy7U2w1aEvVTGVrwpkToIOTqySu2r-70g2HgA0axU8emO_Ne97o-c Jul 04 10:19:25.205061 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Id: None Jul 04 10:19:25.205061 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Name: None Jul 04 10:19:25.205061 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Identity-Status: Confirmed Jul 04 10:19:25.205061 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Is-Admin-Project: True Jul 04 10:19:25.205061 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Id: default Jul 04 10:19:25.205061 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Name: Default Jul 04 10:19:25.205061 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Id: 09b54b24115e4074a79f93c255d4c0ca Jul 04 10:19:25.205061 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Name: tempest-TestMinimumBasicScenario-1620898554 Jul 04 10:19:25.205061 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Role: reader,member Jul 04 10:19:25.205061 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Roles: reader,member Jul 04 10:19:25.206765 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/09b54b24115e4074a79f93c255d4c0ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_09b54b24115e4074a79f93c255d4c0ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/09b54b24115e4074a79f93c255d4c0ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/09b54b24115e4074a79f93c255d4c0ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:19:25.206765 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant: tempest-TestMinimumBasicScenario-1620898554 Jul 04 10:19:25.206765 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Id: 09b54b24115e4074a79f93c255d4c0ca Jul 04 10:19:25.206765 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1620898554 Jul 04 10:19:25.206765 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User: tempest-TestMinimumBasicScenario-1620898554-project Jul 04 10:19:25.206765 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Id: default Jul 04 10:19:25.206765 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Name: Default Jul 04 10:19:25.206765 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Id: 2264f97424ae45ffa5770a66e95897c7 Jul 04 10:19:25.206765 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Name: tempest-TestMinimumBasicScenario-1620898554-project Jul 04 10:19:25.206765 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: method: > Jul 04 10:19:25.206765 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: exception: Instance 36470523-145c-4c32-8ae0-b1d263e1fcf7 is not attached to volume 58b6f474-e7d1-4307-b007-a7e250113f1a Jul 04 10:19:25.207616 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: action_args: {'server_id': '36470523-145c-4c32-8ae0-b1d263e1fcf7', 'id': '58b6f474-e7d1-4307-b007-a7e250113f1a'} Jul 04 10:19:25.207616 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:19:25.207616 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:19:25.207616 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 04 10:19:25.207616 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 04 10:19:25.207616 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 10:19:25.207616 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 10:19:25.207616 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 04 10:19:25.207616 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 04 10:19:25.207616 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 58b6f474-e7d1-4307-b007-a7e250113f1a. Jul 04 10:19:25.207616 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:19:25.207616 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:19:25.207616 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:19:25.207616 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:19:25.207616 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:19:25.207616 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:19:25.207616 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:19:25.207616 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:19:25.207616 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:19:25.209504 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:19:25.209504 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 04 10:19:25.209504 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 04 10:19:25.209504 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36470523-145c-4c32-8ae0-b1d263e1fcf7 is not attached to volume 58b6f474-e7d1-4307-b007-a7e250113f1a Jul 04 10:19:25.209504 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:19:25.209504 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:19:25.209504 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:19:25.209504 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:19:25.209504 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:19:25.209504 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:19:25.209504 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:19:25.209504 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:19:25.209504 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36470523-145c-4c32-8ae0-b1d263e1fcf7 is not attached to volume 58b6f474-e7d1-4307-b007-a7e250113f1a Jul 04 10:19:25.209504 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:19:25.209504 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-f9a70d71-9423-421f-a2f4-a32aa33eb4d5 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Returning 404 to user: Instance 36470523-145c-4c32-8ae0-b1d263e1fcf7 is not attached to volume 58b6f474-e7d1-4307-b007-a7e250113f1a {{(pid=117866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:19:25.210724 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-f9a70d71-9423-421f-a2f4-a32aa33eb4d5 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "DELETE /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7/os-volume_attachments/58b6f474-e7d1-4307-b007-a7e250113f1a" status: 404 len: 154 microversion: 2.1 time: 0.114871 Jul 04 10:19:25.210724 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 492/980] 10.222.0.79 () {58 vars in 1415 bytes} [Mon Jul 4 10:19:25 2022] DELETE /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7/os-volume_attachments/58b6f474-e7d1-4307-b007-a7e250113f1a => generated 154 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:19:26.377542 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b4b586ab-b3b3-464d-9c48-920b54584cd3 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:19:26.378076 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-b4b586ab-b3b3-464d-9c48-920b54584cd3 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:19:26.384912 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b4b586ab-b3b3-464d-9c48-920b54584cd3 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:26.385362 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b4b586ab-b3b3-464d-9c48-920b54584cd3 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:26.386167 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b4b586ab-b3b3-464d-9c48-920b54584cd3 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:26.386592 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b4b586ab-b3b3-464d-9c48-920b54584cd3 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:26.411503 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-b4b586ab-b3b3-464d-9c48-920b54584cd3 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Going to try to terminate instance {{(pid=117865) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 10:19:26.497694 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-b4b586ab-b3b3-464d-9c48-920b54584cd3 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "DELETE /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7" status: 204 len: 0 microversion: 2.1 time: 0.123191 Jul 04 10:19:26.498319 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 489/981] 10.222.0.79 () {58 vars in 1238 bytes} [Mon Jul 4 10:19:26 2022] DELETE /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 10:19:26.508082 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-0d740005-0987-470a-815a-2e32eac7c818 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:19:26.508694 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-0d740005-0987-470a-815a-2e32eac7c818 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:19:26.515367 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0d740005-0987-470a-815a-2e32eac7c818 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:26.515816 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0d740005-0987-470a-815a-2e32eac7c818 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:26.516593 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0d740005-0987-470a-815a-2e32eac7c818 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:26.517028 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-0d740005-0987-470a-815a-2e32eac7c818 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:26.659487 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-0d740005-0987-470a-815a-2e32eac7c818 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2264f97424ae45ffa5770a66e95897c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b54b24115e4074a79f93c255d4c0ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:19:26.669241 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-0d740005-0987-470a-815a-2e32eac7c818 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7" status: 200 len: 1554 microversion: 2.1 time: 0.165725 Jul 04 10:19:26.669765 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 493/982] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:19:26 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:19:27.687445 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-a86ab3a0-c581-4744-a1d2-1a2930055ba9 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:19:27.688110 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-a86ab3a0-c581-4744-a1d2-1a2930055ba9 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:19:27.694858 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a86ab3a0-c581-4744-a1d2-1a2930055ba9 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:27.695300 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a86ab3a0-c581-4744-a1d2-1a2930055ba9 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:27.696075 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a86ab3a0-c581-4744-a1d2-1a2930055ba9 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:27.696485 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a86ab3a0-c581-4744-a1d2-1a2930055ba9 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:27.833702 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-a86ab3a0-c581-4744-a1d2-1a2930055ba9 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2264f97424ae45ffa5770a66e95897c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b54b24115e4074a79f93c255d4c0ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:19:27.842816 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-a86ab3a0-c581-4744-a1d2-1a2930055ba9 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7" status: 200 len: 1554 microversion: 2.1 time: 0.159662 Jul 04 10:19:27.843396 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 490/983] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:19:27 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:19:28.669136 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-cfecc1ae-dbc4-415b-88e1-d1245f14849c req-0d40f095-3ee7-4e56-a6c4-27b869999c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36470523-145c-4c32-8ae0-b1d263e1fcf7", "name": "network-vif-deleted", "tag": "78867a1e-7223-41da-904b-a129d827366b"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:19:28.680497 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-cfecc1ae-dbc4-415b-88e1-d1245f14849c req-0d40f095-3ee7-4e56-a6c4-27b869999c30 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:28.680950 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-cfecc1ae-dbc4-415b-88e1-d1245f14849c req-0d40f095-3ee7-4e56-a6c4-27b869999c30 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:28.692588 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-cfecc1ae-dbc4-415b-88e1-d1245f14849c req-0d40f095-3ee7-4e56-a6c4-27b869999c30 service nova] Creating event network-vif-deleted:78867a1e-7223-41da-904b-a129d827366b for instance 36470523-145c-4c32-8ae0-b1d263e1fcf7 on hv-cinder-84841 Jul 04 10:19:28.697494 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-cfecc1ae-dbc4-415b-88e1-d1245f14849c req-0d40f095-3ee7-4e56-a6c4-27b869999c30 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032216 Jul 04 10:19:28.698140 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 494/984] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:19:28.862719 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-9b57e942-ec4b-4081-b5ff-32e02ea01074 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:19:28.863582 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-9b57e942-ec4b-4081-b5ff-32e02ea01074 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:19:28.873991 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9b57e942-ec4b-4081-b5ff-32e02ea01074 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:28.874717 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9b57e942-ec4b-4081-b5ff-32e02ea01074 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:28.875807 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9b57e942-ec4b-4081-b5ff-32e02ea01074 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:28.876524 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9b57e942-ec4b-4081-b5ff-32e02ea01074 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:28.910863 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9b57e942-ec4b-4081-b5ff-32e02ea01074 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:28.911255 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9b57e942-ec4b-4081-b5ff-32e02ea01074 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:28.911691 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.objects.instance [None req-9b57e942-ec4b-4081-b5ff-32e02ea01074 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lazy-loading 'fault' on Instance uuid 36470523-145c-4c32-8ae0-b1d263e1fcf7 {{(pid=117865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 10:19:28.959933 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-9b57e942-ec4b-4081-b5ff-32e02ea01074 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2264f97424ae45ffa5770a66e95897c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b54b24115e4074a79f93c255d4c0ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:19:28.969717 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-9b57e942-ec4b-4081-b5ff-32e02ea01074 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7" status: 200 len: 1348 microversion: 2.1 time: 0.112929 Jul 04 10:19:28.970458 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 491/985] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:19:28 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 => generated 1348 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:19:29.993689 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-09f0928b-59a4-4cf3-9599-12519d15c751 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:19:29.994390 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-09f0928b-59a4-4cf3-9599-12519d15c751 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] [instance: 36470523-145c-4c32-8ae0-b1d263e1fcf7] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:19:30.000697 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-09f0928b-59a4-4cf3-9599-12519d15c751 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:30.001139 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-09f0928b-59a4-4cf3-9599-12519d15c751 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:30.001927 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-09f0928b-59a4-4cf3-9599-12519d15c751 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:30.002361 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-09f0928b-59a4-4cf3-9599-12519d15c751 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:30.015706 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.wsgi [None req-09f0928b-59a4-4cf3-9599-12519d15c751 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] HTTP exception thrown: Instance 36470523-145c-4c32-8ae0-b1d263e1fcf7 could not be found. Jul 04 10:19:30.017309 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-09f0928b-59a4-4cf3-9599-12519d15c751 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Request method failure captured: Jul 04 10:19:30.017309 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: request: GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 HTTP/1.1 Jul 04 10:19:30.017309 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept: application/json Jul 04 10:19:30.017309 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept-Encoding: identity Jul 04 10:19:30.017309 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Connection: close Jul 04 10:19:30.017309 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Length: 0 Jul 04 10:19:30.017309 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Type: application/json Jul 04 10:19:30.017309 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Host: 10.222.0.79 Jul 04 10:19:30.017309 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Openstack-System-Scope: None Jul 04 10:19:30.017309 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: User-Agent: python-urllib3/1.26.9 Jul 04 10:19:30.017309 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Auth-Token: gAAAAABiwr40anM559mMGaCineQDs6ec65McHM9-81lnLU5BO1K5XZ-sV29-pNMa1mqa6pqH5Cc-tjDSw22ih25Ee3-W2ztPyyVp2l19pVW7TR6uYO9CBRYUAZFUzLxJ3iPy7U2w1aEvVTGVrwpkToIOTqySu2r-70g2HgA0axU8emO_Ne97o-c Jul 04 10:19:30.017309 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Id: None Jul 04 10:19:30.017309 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Name: None Jul 04 10:19:30.017309 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Identity-Status: Confirmed Jul 04 10:19:30.017309 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Is-Admin-Project: True Jul 04 10:19:30.017309 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Id: default Jul 04 10:19:30.017309 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Name: Default Jul 04 10:19:30.017309 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Id: 09b54b24115e4074a79f93c255d4c0ca Jul 04 10:19:30.017309 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Name: tempest-TestMinimumBasicScenario-1620898554 Jul 04 10:19:30.017309 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Role: reader,member Jul 04 10:19:30.017309 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Roles: reader,member Jul 04 10:19:30.018919 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/09b54b24115e4074a79f93c255d4c0ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_09b54b24115e4074a79f93c255d4c0ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/09b54b24115e4074a79f93c255d4c0ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/09b54b24115e4074a79f93c255d4c0ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:19:30.018919 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant: tempest-TestMinimumBasicScenario-1620898554 Jul 04 10:19:30.018919 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Id: 09b54b24115e4074a79f93c255d4c0ca Jul 04 10:19:30.018919 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1620898554 Jul 04 10:19:30.018919 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User: tempest-TestMinimumBasicScenario-1620898554-project Jul 04 10:19:30.018919 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Id: default Jul 04 10:19:30.018919 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Name: Default Jul 04 10:19:30.018919 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Id: 2264f97424ae45ffa5770a66e95897c7 Jul 04 10:19:30.018919 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Name: tempest-TestMinimumBasicScenario-1620898554-project Jul 04 10:19:30.018919 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: method: > Jul 04 10:19:30.018919 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: exception: Instance 36470523-145c-4c32-8ae0-b1d263e1fcf7 could not be found. Jul 04 10:19:30.018919 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: action_args: {'id': '36470523-145c-4c32-8ae0-b1d263e1fcf7'} Jul 04 10:19:30.019901 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:19:30.019901 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:19:30.019901 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:19:30.019901 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:19:30.019901 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:19:30.019901 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:19:30.019901 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:19:30.019901 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:19:30.019901 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:19:30.019901 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:19:30.019901 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36470523-145c-4c32-8ae0-b1d263e1fcf7 could not be found. Jul 04 10:19:30.019901 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:19:30.019901 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:19:30.019901 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:19:30.019901 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:19:30.019901 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:19:30.019901 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:19:30.019901 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:19:30.019901 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:19:30.019901 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:19:30.021373 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:19:30.021373 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 10:19:30.021373 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 10:19:30.021373 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:19:30.021373 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:19:30.021373 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:19:30.021373 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:19:30.021373 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36470523-145c-4c32-8ae0-b1d263e1fcf7 could not be found. Jul 04 10:19:30.021373 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:19:30.021373 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:19:30.021373 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:19:30.021373 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:19:30.021373 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:19:30.021373 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:19:30.021373 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:19:30.021373 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:19:30.021373 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36470523-145c-4c32-8ae0-b1d263e1fcf7 could not be found. Jul 04 10:19:30.021373 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:19:30.023158 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-09f0928b-59a4-4cf3-9599-12519d15c751 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Returning 404 to user: Instance 36470523-145c-4c32-8ae0-b1d263e1fcf7 could not be found. {{(pid=117866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:19:30.023158 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-09f0928b-59a4-4cf3-9599-12519d15c751 tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7" status: 404 len: 111 microversion: 2.1 time: 0.032001 Jul 04 10:19:30.023158 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 495/986] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:19:29 2022] GET /compute/v2.1/servers/36470523-145c-4c32-8ae0-b1d263e1fcf7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:19:30.027718 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-a5ad7980-fe8f-4e8e-9b03-67aa6d5f51dc tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] Calling method '.version_select at 0x7f2808150430>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:19:30.048049 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-a5ad7980-fe8f-4e8e-9b03-67aa6d5f51dc tempest-TestMinimumBasicScenario-1620898554 tempest-TestMinimumBasicScenario-1620898554-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-999650392" status: 202 len: 0 microversion: 2.1 time: 0.024128 Jul 04 10:19:30.048589 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 492/987] 10.222.0.79 () {58 vars in 1268 bytes} [Mon Jul 4 10:19:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-999650392 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 04 10:19:54.000447 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-fbd7958e-630c-451e-9d87-ed455600790d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:19:54.001208 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-fbd7958e-630c-451e-9d87-ed455600790d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 0ab0336f-8710-421e-8d13-a3ca20ccdb6a] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:19:54.004520 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_api:SELECT=14 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:19:54.005355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell1:SELECT=26 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:19:54.013147 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-fbd7958e-630c-451e-9d87-ed455600790d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:54.013887 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-fbd7958e-630c-451e-9d87-ed455600790d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:54.014818 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-fbd7958e-630c-451e-9d87-ed455600790d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:54.015425 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-fbd7958e-630c-451e-9d87-ed455600790d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:54.042405 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-fbd7958e-630c-451e-9d87-ed455600790d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 0ab0336f-8710-421e-8d13-a3ca20ccdb6a] Going to try to terminate instance {{(pid=117866) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 10:19:54.124739 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-fbd7958e-630c-451e-9d87-ed455600790d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a" status: 204 len: 0 microversion: 2.1 time: 0.129267 Jul 04 10:19:54.128796 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 496/988] 10.222.0.79 () {58 vars in 1238 bytes} [Mon Jul 4 10:19:53 2022] DELETE /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 10:19:54.131981 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:19:54.132855 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:19:54.137237 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2009848c-b1d8-4e57-ab09-cee486f70d4b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:19:54.139113 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-2009848c-b1d8-4e57-ab09-cee486f70d4b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 0ab0336f-8710-421e-8d13-a3ca20ccdb6a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:19:54.151069 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2009848c-b1d8-4e57-ab09-cee486f70d4b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:54.151515 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2009848c-b1d8-4e57-ab09-cee486f70d4b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:54.152328 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2009848c-b1d8-4e57-ab09-cee486f70d4b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:54.152755 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2009848c-b1d8-4e57-ab09-cee486f70d4b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:54.295800 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-2009848c-b1d8-4e57-ab09-cee486f70d4b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:19:54.306968 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-2009848c-b1d8-4e57-ab09-cee486f70d4b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a" status: 200 len: 1578 microversion: 2.1 time: 0.176628 Jul 04 10:19:54.307507 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 493/989] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:19:54 2022] GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a => generated 1578 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:19:55.326324 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-ae1c6661-d05b-4686-a21b-02b65a653290 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:19:55.326984 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-ae1c6661-d05b-4686-a21b-02b65a653290 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 0ab0336f-8710-421e-8d13-a3ca20ccdb6a] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:19:55.334212 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ae1c6661-d05b-4686-a21b-02b65a653290 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:55.334666 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ae1c6661-d05b-4686-a21b-02b65a653290 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:55.335785 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ae1c6661-d05b-4686-a21b-02b65a653290 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:55.336220 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ae1c6661-d05b-4686-a21b-02b65a653290 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:55.478029 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-ae1c6661-d05b-4686-a21b-02b65a653290 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:19:55.488371 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-ae1c6661-d05b-4686-a21b-02b65a653290 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a" status: 200 len: 1578 microversion: 2.1 time: 0.166477 Jul 04 10:19:55.488943 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 497/990] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:19:55 2022] GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:19:56.506192 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-db8a24bb-e6e1-4d6f-9c69-862ab73fd08b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:19:56.507502 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-db8a24bb-e6e1-4d6f-9c69-862ab73fd08b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 0ab0336f-8710-421e-8d13-a3ca20ccdb6a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:19:56.514831 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-db8a24bb-e6e1-4d6f-9c69-862ab73fd08b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:56.515245 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-db8a24bb-e6e1-4d6f-9c69-862ab73fd08b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:56.516286 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-db8a24bb-e6e1-4d6f-9c69-862ab73fd08b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:56.516817 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-db8a24bb-e6e1-4d6f-9c69-862ab73fd08b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:56.779734 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-db8a24bb-e6e1-4d6f-9c69-862ab73fd08b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:19:56.799070 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-db8a24bb-e6e1-4d6f-9c69-862ab73fd08b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a" status: 200 len: 1510 microversion: 2.1 time: 0.296587 Jul 04 10:19:56.809654 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 494/991] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:19:56 2022] GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a => generated 1510 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:19:56.985849 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-40a1c316-edd0-4f87-892a-ba5b1ae8f7e0 req-3a4f2e14-51c4-4124-914e-071279430400 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ab0336f-8710-421e-8d13-a3ca20ccdb6a", "name": "network-vif-deleted", "tag": "dd8a2307-84be-4a9e-b5e9-cadd43e51328"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:19:56.995446 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-40a1c316-edd0-4f87-892a-ba5b1ae8f7e0 req-3a4f2e14-51c4-4124-914e-071279430400 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:56.995895 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-40a1c316-edd0-4f87-892a-ba5b1ae8f7e0 req-3a4f2e14-51c4-4124-914e-071279430400 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:57.010461 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-40a1c316-edd0-4f87-892a-ba5b1ae8f7e0 req-3a4f2e14-51c4-4124-914e-071279430400 service nova] Creating event network-vif-deleted:dd8a2307-84be-4a9e-b5e9-cadd43e51328 for instance 0ab0336f-8710-421e-8d13-a3ca20ccdb6a on hv-cinder-84841 Jul 04 10:19:57.016804 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-40a1c316-edd0-4f87-892a-ba5b1ae8f7e0 req-3a4f2e14-51c4-4124-914e-071279430400 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.229669 Jul 04 10:19:57.019023 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 498/992] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:19:57.820777 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-eded4e89-7f98-4589-98dc-ca9f2a23fefa tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:19:57.821890 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-eded4e89-7f98-4589-98dc-ca9f2a23fefa tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 0ab0336f-8710-421e-8d13-a3ca20ccdb6a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:19:57.831514 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-eded4e89-7f98-4589-98dc-ca9f2a23fefa tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:57.831960 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-eded4e89-7f98-4589-98dc-ca9f2a23fefa tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:57.832710 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-eded4e89-7f98-4589-98dc-ca9f2a23fefa tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:57.833135 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-eded4e89-7f98-4589-98dc-ca9f2a23fefa tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:57.847224 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-eded4e89-7f98-4589-98dc-ca9f2a23fefa tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] HTTP exception thrown: Instance 0ab0336f-8710-421e-8d13-a3ca20ccdb6a could not be found. Jul 04 10:19:57.848884 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-eded4e89-7f98-4589-98dc-ca9f2a23fefa tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Request method failure captured: Jul 04 10:19:57.848884 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: request: GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a HTTP/1.1 Jul 04 10:19:57.848884 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept: application/json Jul 04 10:19:57.848884 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept-Encoding: identity Jul 04 10:19:57.848884 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Connection: close Jul 04 10:19:57.848884 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Length: 0 Jul 04 10:19:57.848884 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Type: application/json Jul 04 10:19:57.848884 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Host: 10.222.0.79 Jul 04 10:19:57.848884 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 04 10:19:57.848884 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 04 10:19:57.848884 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Auth-Token: gAAAAABiwr4kTUQJmRY3LQuZKqYus7xRPQ1jwudPqj5BMIXPUiZp2STyJC9AnDvU5QsfHsflZih4ckOfyCYJk4kDxT_ace37WZhM2ldYcLl7R5ZJRlUWsxbBfHPOnmDfPE5gzwZzU42sdcikHk4B6gqZF-YKVOjXIlOOoYJvkrTeT1rS_5jMslE Jul 04 10:19:57.848884 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Id: None Jul 04 10:19:57.848884 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Name: None Jul 04 10:19:57.848884 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 04 10:19:57.848884 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 04 10:19:57.848884 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 04 10:19:57.848884 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 04 10:19:57.848884 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Id: aaff1fa03a194074aa14fae9db94cefb Jul 04 10:19:57.848884 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Name: tempest-TestVolumeBootPattern-862963616 Jul 04 10:19:57.848884 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Role: reader,member Jul 04 10:19:57.848884 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Roles: reader,member Jul 04 10:19:57.850631 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/aaff1fa03a194074aa14fae9db94cefb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_aaff1fa03a194074aa14fae9db94cefb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/aaff1fa03a194074aa14fae9db94cefb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/aaff1fa03a194074aa14fae9db94cefb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:19:57.850631 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant: tempest-TestVolumeBootPattern-862963616 Jul 04 10:19:57.850631 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Id: aaff1fa03a194074aa14fae9db94cefb Jul 04 10:19:57.850631 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Name: tempest-TestVolumeBootPattern-862963616 Jul 04 10:19:57.850631 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User: tempest-TestVolumeBootPattern-862963616-project Jul 04 10:19:57.850631 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 04 10:19:57.850631 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 04 10:19:57.850631 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Id: 2321028b4d4f4734afd1ce674931a4d3 Jul 04 10:19:57.850631 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Name: tempest-TestVolumeBootPattern-862963616-project Jul 04 10:19:57.850631 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: method: > Jul 04 10:19:57.850631 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: exception: Instance 0ab0336f-8710-421e-8d13-a3ca20ccdb6a could not be found. Jul 04 10:19:57.850631 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: action_args: {'id': '0ab0336f-8710-421e-8d13-a3ca20ccdb6a'} Jul 04 10:19:57.851611 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:19:57.851611 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:19:57.851611 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:19:57.851611 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:19:57.851611 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:19:57.851611 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:19:57.851611 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:19:57.851611 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:19:57.851611 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:19:57.851611 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:19:57.851611 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ab0336f-8710-421e-8d13-a3ca20ccdb6a could not be found. Jul 04 10:19:57.851611 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:19:57.851611 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:19:57.851611 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:19:57.851611 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:19:57.851611 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:19:57.851611 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:19:57.851611 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:19:57.851611 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:19:57.851611 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:19:57.853198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:19:57.853198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 10:19:57.853198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 10:19:57.853198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:19:57.853198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:19:57.853198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:19:57.853198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:19:57.853198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ab0336f-8710-421e-8d13-a3ca20ccdb6a could not be found. Jul 04 10:19:57.853198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:19:57.853198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:19:57.853198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:19:57.853198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:19:57.853198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:19:57.853198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:19:57.853198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:19:57.853198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:19:57.853198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ab0336f-8710-421e-8d13-a3ca20ccdb6a could not be found. Jul 04 10:19:57.853198 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:19:57.854754 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-eded4e89-7f98-4589-98dc-ca9f2a23fefa tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Returning 404 to user: Instance 0ab0336f-8710-421e-8d13-a3ca20ccdb6a could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:19:57.854754 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-eded4e89-7f98-4589-98dc-ca9f2a23fefa tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a" status: 404 len: 111 microversion: 2.1 time: 0.035980 Jul 04 10:19:57.854754 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 495/993] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:19:57 2022] GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:19:57.955498 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-71a609a2-37d4-48ac-b669-fbc0be086460 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-358739014", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1580130653", "security_groups": [{"name": "tempest-secgroup-smoke-1337804478"}], "block_device_mapping_v2": [{"uuid": "2b53383f-9dbc-4bf2-893b-85ce938124b2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "28daa053-6dc3-4bbf-8b82-7f4c430042da"}]}} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:19:58.079231 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.network.neutron [None req-71a609a2-37d4-48ac-b669-fbc0be086460 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] validate_networks() for [('28daa053-6dc3-4bbf-8b82-7f4c430042da', None, None, None, None, None)] {{(pid=117866) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 10:19:58.584023 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-71a609a2-37d4-48ac-b669-fbc0be086460 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Flavor limits 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 10:19:58.584470 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-71a609a2-37d4-48ac-b669-fbc0be086460 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Image limits 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 10:19:58.584932 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-71a609a2-37d4-48ac-b669-fbc0be086460 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Flavor pref 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 10:19:58.585707 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-71a609a2-37d4-48ac-b669-fbc0be086460 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Image pref 0:0:0 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 10:19:58.586104 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.virt.hardware [None req-71a609a2-37d4-48ac-b669-fbc0be086460 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 10:19:58.595907 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-71a609a2-37d4-48ac-b669-fbc0be086460 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:58.596347 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-71a609a2-37d4-48ac-b669-fbc0be086460 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:58.597139 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-71a609a2-37d4-48ac-b669-fbc0be086460 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:19:58.597567 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-71a609a2-37d4-48ac-b669-fbc0be086460 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:19:58.615040 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.quota [None req-71a609a2-37d4-48ac-b669-fbc0be086460 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Getting quotas for project aaff1fa03a194074aa14fae9db94cefb. Resources: {'cores', 'ram', 'instances'} {{(pid=117866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 10:19:58.619115 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.quota [None req-71a609a2-37d4-48ac-b669-fbc0be086460 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Getting quotas for user 2321028b4d4f4734afd1ce674931a4d3 and project aaff1fa03a194074aa14fae9db94cefb. Resources: {'cores', 'ram', 'instances'} {{(pid=117866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 10:19:58.676628 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-71a609a2-37d4-48ac-b669-fbc0be086460 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Going to run 1 instances... {{(pid=117866) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 10:19:58.678884 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-71a609a2-37d4-48ac-b669-fbc0be086460 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 343223e4-5ea9-4347-8cb7-82aafa314cba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2b53383f-9dbc-4bf2-893b-85ce938124b2',volume_size=None,volume_type=None)] {{(pid=117866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 10:19:58.812291 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR oslo.messaging._drivers.impl_rabbit [None req-71a609a2-37d4-48ac-b669-fbc0be086460 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [aa737606-965f-49b6-91f7-a38322f8d3f5] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 04 10:19:59.824923 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO oslo.messaging._drivers.impl_rabbit [None req-71a609a2-37d4-48ac-b669-fbc0be086460 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [aa737606-965f-49b6-91f7-a38322f8d3f5] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 40162. Jul 04 10:19:59.833154 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-71a609a2-37d4-48ac-b669-fbc0be086460 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.882049 Jul 04 10:19:59.834389 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 499/994] 10.222.0.79 () {60 vars in 1146 bytes} [Mon Jul 4 10:19:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 1884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 10:19:59.849223 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b9055a96-cb99-4465-969a-8c27ce334bbe tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:19:59.849823 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-b9055a96-cb99-4465-969a-8c27ce334bbe tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 343223e4-5ea9-4347-8cb7-82aafa314cba] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:19:59.909550 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-b9055a96-cb99-4465-969a-8c27ce334bbe tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:19:59.919788 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-b9055a96-cb99-4465-969a-8c27ce334bbe tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba" status: 200 len: 1094 microversion: 2.1 time: 0.074488 Jul 04 10:19:59.920518 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 496/995] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:19:59 2022] GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:20:00.937089 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-25c150b0-e5f1-41de-bf3e-4e37d15ea57a tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:20:00.937982 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-25c150b0-e5f1-41de-bf3e-4e37d15ea57a tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 343223e4-5ea9-4347-8cb7-82aafa314cba] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:20:00.992876 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-25c150b0-e5f1-41de-bf3e-4e37d15ea57a tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:20:01.001865 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-25c150b0-e5f1-41de-bf3e-4e37d15ea57a tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba" status: 200 len: 1094 microversion: 2.1 time: 0.069091 Jul 04 10:20:01.002512 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 500/996] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:20:00 2022] GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:20:02.019961 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-4b0756d1-61bf-42f1-b946-205e401055d5 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:20:02.020578 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-4b0756d1-61bf-42f1-b946-205e401055d5 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 343223e4-5ea9-4347-8cb7-82aafa314cba] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:20:02.080512 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-4b0756d1-61bf-42f1-b946-205e401055d5 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:20:02.087956 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-4b0756d1-61bf-42f1-b946-205e401055d5 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba" status: 200 len: 1094 microversion: 2.1 time: 0.072647 Jul 04 10:20:02.088509 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 497/997] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:20:02 2022] GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:20:03.108988 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-93154d38-4207-4561-87c9-9cb1dad31431 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:20:03.110032 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-93154d38-4207-4561-87c9-9cb1dad31431 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 343223e4-5ea9-4347-8cb7-82aafa314cba] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:20:03.168235 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-93154d38-4207-4561-87c9-9cb1dad31431 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:20:03.178972 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-93154d38-4207-4561-87c9-9cb1dad31431 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba" status: 200 len: 1094 microversion: 2.1 time: 0.076105 Jul 04 10:20:03.179673 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 501/998] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:20:03 2022] GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:20:04.202017 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-069ce9a3-bef3-4f10-b277-227ff6d6ee0e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:20:04.202951 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-069ce9a3-bef3-4f10-b277-227ff6d6ee0e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 343223e4-5ea9-4347-8cb7-82aafa314cba] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:20:04.214591 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-069ce9a3-bef3-4f10-b277-227ff6d6ee0e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:20:04.215319 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-069ce9a3-bef3-4f10-b277-227ff6d6ee0e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:20:04.216565 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-069ce9a3-bef3-4f10-b277-227ff6d6ee0e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:20:04.217268 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-069ce9a3-bef3-4f10-b277-227ff6d6ee0e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:20:04.286970 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-069ce9a3-bef3-4f10-b277-227ff6d6ee0e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:20:04.294744 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-069ce9a3-bef3-4f10-b277-227ff6d6ee0e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba" status: 200 len: 1144 microversion: 2.1 time: 0.099215 Jul 04 10:20:04.295318 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 498/999] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:20:04 2022] GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba => generated 1144 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:20:05.311402 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-3e294fc7-b4f9-47f1-a19f-d26687558b85 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:20:05.312015 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-3e294fc7-b4f9-47f1-a19f-d26687558b85 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 343223e4-5ea9-4347-8cb7-82aafa314cba] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:20:05.318794 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3e294fc7-b4f9-47f1-a19f-d26687558b85 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:20:05.319240 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3e294fc7-b4f9-47f1-a19f-d26687558b85 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:20:05.320052 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3e294fc7-b4f9-47f1-a19f-d26687558b85 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:20:05.320483 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3e294fc7-b4f9-47f1-a19f-d26687558b85 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:20:05.400886 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-3e294fc7-b4f9-47f1-a19f-d26687558b85 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:20:05.409156 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-3e294fc7-b4f9-47f1-a19f-d26687558b85 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba" status: 200 len: 1210 microversion: 2.1 time: 0.101790 Jul 04 10:20:05.409778 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 502/1000] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:20:05 2022] GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba => generated 1210 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:20:06.339455 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-db192fca-0ddb-440a-b5b0-bfb2c2f2c8e7 req-6de9bcaa-4b90-4a1a-884e-f5e45b7372a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "343223e4-5ea9-4347-8cb7-82aafa314cba", "tag": "18bb8690-9fd0-473c-a2fc-7b49d7d836f2"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:20:06.348610 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-db192fca-0ddb-440a-b5b0-bfb2c2f2c8e7 req-6de9bcaa-4b90-4a1a-884e-f5e45b7372a0 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:20:06.349039 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-db192fca-0ddb-440a-b5b0-bfb2c2f2c8e7 req-6de9bcaa-4b90-4a1a-884e-f5e45b7372a0 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:20:06.360652 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-db192fca-0ddb-440a-b5b0-bfb2c2f2c8e7 req-6de9bcaa-4b90-4a1a-884e-f5e45b7372a0 service nova] Creating event network-changed:18bb8690-9fd0-473c-a2fc-7b49d7d836f2 for instance 343223e4-5ea9-4347-8cb7-82aafa314cba on hv-cinder-84841 Jul 04 10:20:06.366303 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-db192fca-0ddb-440a-b5b0-bfb2c2f2c8e7 req-6de9bcaa-4b90-4a1a-884e-f5e45b7372a0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031088 Jul 04 10:20:06.366978 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 499/1001] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:20:06.427520 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-104d6128-ca40-47f7-9c35-15f6c09ed8b4 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:20:06.428133 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-104d6128-ca40-47f7-9c35-15f6c09ed8b4 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 343223e4-5ea9-4347-8cb7-82aafa314cba] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:20:06.435308 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-104d6128-ca40-47f7-9c35-15f6c09ed8b4 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:20:06.435818 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-104d6128-ca40-47f7-9c35-15f6c09ed8b4 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:20:06.436677 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-104d6128-ca40-47f7-9c35-15f6c09ed8b4 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:20:06.437299 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-104d6128-ca40-47f7-9c35-15f6c09ed8b4 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:20:06.657436 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-104d6128-ca40-47f7-9c35-15f6c09ed8b4 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:20:06.665564 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-104d6128-ca40-47f7-9c35-15f6c09ed8b4 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba" status: 200 len: 1266 microversion: 2.1 time: 0.242594 Jul 04 10:20:06.666324 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 503/1002] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:20:06 2022] GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:20:07.689253 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-267aa7c5-8d9b-41e5-84ad-b9f3a3f7730c tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:20:07.690400 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-267aa7c5-8d9b-41e5-84ad-b9f3a3f7730c tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 343223e4-5ea9-4347-8cb7-82aafa314cba] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:20:07.701003 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-267aa7c5-8d9b-41e5-84ad-b9f3a3f7730c tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:20:07.701826 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-267aa7c5-8d9b-41e5-84ad-b9f3a3f7730c tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:20:07.703073 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-267aa7c5-8d9b-41e5-84ad-b9f3a3f7730c tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:20:07.703781 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-267aa7c5-8d9b-41e5-84ad-b9f3a3f7730c tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:20:07.848217 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-267aa7c5-8d9b-41e5-84ad-b9f3a3f7730c tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:20:07.856411 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-267aa7c5-8d9b-41e5-84ad-b9f3a3f7730c tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba" status: 200 len: 1266 microversion: 2.1 time: 0.175057 Jul 04 10:20:07.856982 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 500/1003] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:20:07 2022] GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:20:08.874951 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-8f9de71a-fbf0-4eeb-8234-419017541159 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:20:08.875729 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-8f9de71a-fbf0-4eeb-8234-419017541159 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 343223e4-5ea9-4347-8cb7-82aafa314cba] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:20:08.879212 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell0:SELECT=2 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:20:08.886489 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8f9de71a-fbf0-4eeb-8234-419017541159 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:20:08.887078 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8f9de71a-fbf0-4eeb-8234-419017541159 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:20:08.888113 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8f9de71a-fbf0-4eeb-8234-419017541159 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:20:08.888680 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8f9de71a-fbf0-4eeb-8234-419017541159 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:20:09.032043 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-8f9de71a-fbf0-4eeb-8234-419017541159 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:20:09.043466 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-8f9de71a-fbf0-4eeb-8234-419017541159 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba" status: 200 len: 1266 microversion: 2.1 time: 0.173452 Jul 04 10:20:09.044228 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 504/1004] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:20:08 2022] GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:20:10.065702 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-06ccf4d7-090a-408f-b96e-df16e23bfa5a tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:20:10.066951 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-06ccf4d7-090a-408f-b96e-df16e23bfa5a tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 343223e4-5ea9-4347-8cb7-82aafa314cba] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:20:10.074607 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-06ccf4d7-090a-408f-b96e-df16e23bfa5a tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:20:10.075104 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-06ccf4d7-090a-408f-b96e-df16e23bfa5a tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:20:10.075953 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-06ccf4d7-090a-408f-b96e-df16e23bfa5a tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:20:10.076429 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-06ccf4d7-090a-408f-b96e-df16e23bfa5a tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:20:10.214619 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-06ccf4d7-090a-408f-b96e-df16e23bfa5a tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:20:10.223030 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-06ccf4d7-090a-408f-b96e-df16e23bfa5a tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba" status: 200 len: 1266 microversion: 2.1 time: 0.163637 Jul 04 10:20:10.223604 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 501/1005] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:20:10 2022] GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:20:11.244562 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-18d21040-f745-4107-a680-8638365af52f tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:20:11.245437 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-18d21040-f745-4107-a680-8638365af52f tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 343223e4-5ea9-4347-8cb7-82aafa314cba] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:20:11.256495 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-18d21040-f745-4107-a680-8638365af52f tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:20:11.257222 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-18d21040-f745-4107-a680-8638365af52f tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:20:11.258516 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-18d21040-f745-4107-a680-8638365af52f tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:20:11.259219 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-18d21040-f745-4107-a680-8638365af52f tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:20:11.402176 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-18d21040-f745-4107-a680-8638365af52f tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:20:11.413693 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-18d21040-f745-4107-a680-8638365af52f tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba" status: 200 len: 1266 microversion: 2.1 time: 0.175634 Jul 04 10:20:11.414588 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 505/1006] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:20:11 2022] GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:20:12.435786 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-79a76080-a6a4-442c-988b-f954d40a52a9 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:20:12.436663 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-79a76080-a6a4-442c-988b-f954d40a52a9 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 343223e4-5ea9-4347-8cb7-82aafa314cba] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:20:12.440406 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=4 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:20:12.446714 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-79a76080-a6a4-442c-988b-f954d40a52a9 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:20:12.447153 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-79a76080-a6a4-442c-988b-f954d40a52a9 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:20:12.447931 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-79a76080-a6a4-442c-988b-f954d40a52a9 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:20:12.448351 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-79a76080-a6a4-442c-988b-f954d40a52a9 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:20:12.582320 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-79a76080-a6a4-442c-988b-f954d40a52a9 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:20:12.590495 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-79a76080-a6a4-442c-988b-f954d40a52a9 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba" status: 200 len: 1266 microversion: 2.1 time: 0.161693 Jul 04 10:20:12.591060 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 502/1007] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:20:12 2022] GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:20:13.610435 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-8bd87ca4-c98d-41cf-970f-542cd503e664 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:20:13.611083 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-8bd87ca4-c98d-41cf-970f-542cd503e664 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 343223e4-5ea9-4347-8cb7-82aafa314cba] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:20:13.614332 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell0:SELECT=10 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:20:13.620086 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8bd87ca4-c98d-41cf-970f-542cd503e664 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:20:13.620534 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8bd87ca4-c98d-41cf-970f-542cd503e664 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:20:13.621302 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8bd87ca4-c98d-41cf-970f-542cd503e664 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:20:13.621761 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-8bd87ca4-c98d-41cf-970f-542cd503e664 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:20:13.768635 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-8bd87ca4-c98d-41cf-970f-542cd503e664 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:20:13.780356 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-8bd87ca4-c98d-41cf-970f-542cd503e664 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba" status: 200 len: 1266 microversion: 2.1 time: 0.175803 Jul 04 10:20:13.781080 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 506/1008] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:20:13 2022] GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:20:14.802864 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-265052c4-bf13-47f7-b1e2-a1026df77f0e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:20:14.803481 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-265052c4-bf13-47f7-b1e2-a1026df77f0e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 343223e4-5ea9-4347-8cb7-82aafa314cba] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:20:14.810553 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-265052c4-bf13-47f7-b1e2-a1026df77f0e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:20:14.811003 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-265052c4-bf13-47f7-b1e2-a1026df77f0e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:20:14.811762 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-265052c4-bf13-47f7-b1e2-a1026df77f0e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:20:14.812191 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-265052c4-bf13-47f7-b1e2-a1026df77f0e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:20:14.953383 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-265052c4-bf13-47f7-b1e2-a1026df77f0e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:20:14.961548 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-265052c4-bf13-47f7-b1e2-a1026df77f0e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba" status: 200 len: 1266 microversion: 2.1 time: 0.164364 Jul 04 10:20:14.962415 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 503/1009] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:20:14 2022] GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:20:15.117795 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-f9ec72fb-8fbc-466a-bc00-83a6f79ae261 req-c195f854-5e3e-4a4e-9780-0f35649463c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "343223e4-5ea9-4347-8cb7-82aafa314cba", "name": "network-vif-plugged", "status": "completed", "tag": "18bb8690-9fd0-473c-a2fc-7b49d7d836f2"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:20:15.126425 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-f9ec72fb-8fbc-466a-bc00-83a6f79ae261 req-c195f854-5e3e-4a4e-9780-0f35649463c8 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:20:15.126863 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-f9ec72fb-8fbc-466a-bc00-83a6f79ae261 req-c195f854-5e3e-4a4e-9780-0f35649463c8 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:20:15.138538 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-f9ec72fb-8fbc-466a-bc00-83a6f79ae261 req-c195f854-5e3e-4a4e-9780-0f35649463c8 service nova] Creating event network-vif-plugged:18bb8690-9fd0-473c-a2fc-7b49d7d836f2 for instance 343223e4-5ea9-4347-8cb7-82aafa314cba on hv-cinder-84841 Jul 04 10:20:15.143850 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-f9ec72fb-8fbc-466a-bc00-83a6f79ae261 req-c195f854-5e3e-4a4e-9780-0f35649463c8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094602 Jul 04 10:20:15.144553 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 507/1010] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:20:15.979407 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b95103b1-f1ae-48b9-a830-8ee706cd977d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:20:15.980663 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-b95103b1-f1ae-48b9-a830-8ee706cd977d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 343223e4-5ea9-4347-8cb7-82aafa314cba] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:20:15.987569 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b95103b1-f1ae-48b9-a830-8ee706cd977d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:20:15.988014 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b95103b1-f1ae-48b9-a830-8ee706cd977d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:20:15.988872 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b95103b1-f1ae-48b9-a830-8ee706cd977d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:20:15.989228 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b95103b1-f1ae-48b9-a830-8ee706cd977d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:20:16.122459 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-b95103b1-f1ae-48b9-a830-8ee706cd977d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:20:16.130174 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-b95103b1-f1ae-48b9-a830-8ee706cd977d tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba" status: 200 len: 1266 microversion: 2.1 time: 0.154686 Jul 04 10:20:16.130867 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 504/1011] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:20:15 2022] GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:20:17.150318 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-3a4bb14e-5a2b-40a6-b0d7-0106f01232c8 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:20:17.151005 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-3a4bb14e-5a2b-40a6-b0d7-0106f01232c8 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 343223e4-5ea9-4347-8cb7-82aafa314cba] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:20:17.157801 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3a4bb14e-5a2b-40a6-b0d7-0106f01232c8 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:20:17.158246 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3a4bb14e-5a2b-40a6-b0d7-0106f01232c8 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:20:17.159000 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3a4bb14e-5a2b-40a6-b0d7-0106f01232c8 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:20:17.159426 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-3a4bb14e-5a2b-40a6-b0d7-0106f01232c8 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:20:17.300497 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-3a4bb14e-5a2b-40a6-b0d7-0106f01232c8 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:20:17.308859 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-3a4bb14e-5a2b-40a6-b0d7-0106f01232c8 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba" status: 200 len: 1453 microversion: 2.1 time: 0.163774 Jul 04 10:20:17.309427 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 508/1012] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:20:17 2022] GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba => generated 1453 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:20:17.325083 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-fd33e45e-2835-495b-8db1-4e72bb7b4baf tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:20:17.325683 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-fd33e45e-2835-495b-8db1-4e72bb7b4baf tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 343223e4-5ea9-4347-8cb7-82aafa314cba] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:20:17.332614 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fd33e45e-2835-495b-8db1-4e72bb7b4baf tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:20:17.333130 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fd33e45e-2835-495b-8db1-4e72bb7b4baf tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:20:17.333921 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fd33e45e-2835-495b-8db1-4e72bb7b4baf tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:20:17.334339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fd33e45e-2835-495b-8db1-4e72bb7b4baf tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:20:17.483948 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-fd33e45e-2835-495b-8db1-4e72bb7b4baf tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:20:17.492206 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-fd33e45e-2835-495b-8db1-4e72bb7b4baf tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba" status: 200 len: 1453 microversion: 2.1 time: 0.170952 Jul 04 10:20:17.492775 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 505/1013] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:20:17 2022] GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba => generated 1453 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:20:19.347720 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-c10bf75a-091b-49ce-9e5f-3af0e84d0695 req-94813d05-bd12-4281-b6e7-469c7958b805 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "343223e4-5ea9-4347-8cb7-82aafa314cba", "tag": "18bb8690-9fd0-473c-a2fc-7b49d7d836f2"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:20:19.356509 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-c10bf75a-091b-49ce-9e5f-3af0e84d0695 req-94813d05-bd12-4281-b6e7-469c7958b805 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:20:19.356953 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-c10bf75a-091b-49ce-9e5f-3af0e84d0695 req-94813d05-bd12-4281-b6e7-469c7958b805 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:20:19.368350 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-c10bf75a-091b-49ce-9e5f-3af0e84d0695 req-94813d05-bd12-4281-b6e7-469c7958b805 service nova] Creating event network-changed:18bb8690-9fd0-473c-a2fc-7b49d7d836f2 for instance 343223e4-5ea9-4347-8cb7-82aafa314cba on hv-cinder-84841 Jul 04 10:20:19.373247 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-c10bf75a-091b-49ce-9e5f-3af0e84d0695 req-94813d05-bd12-4281-b6e7-469c7958b805 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029538 Jul 04 10:20:19.373875 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 509/1014] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:20:26.055040 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 10:20:26.056152 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Mon Jul 4 10:20:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 10:20:26.934906 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 10:20:26.935574 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Mon Jul 4 10:20:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 10:21:53.613610 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=30 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:21:53.614434 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=58 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:21:53.618503 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b6e82a39-8933-4eef-a9fd-3750492af0a7 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2081164889", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1580130653", "security_groups": [{"name": "tempest-secgroup-smoke-1337804478"}], "block_device_mapping_v2": [{"uuid": "d76bcb03-cfef-4986-9b8d-91995ff4597f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "28daa053-6dc3-4bbf-8b82-7f4c430042da"}]}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:21:53.734649 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.network.neutron [None req-b6e82a39-8933-4eef-a9fd-3750492af0a7 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] validate_networks() for [('28daa053-6dc3-4bbf-8b82-7f4c430042da', None, None, None, None, None)] {{(pid=117865) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 10:21:54.211997 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-b6e82a39-8933-4eef-a9fd-3750492af0a7 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Flavor limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 10:21:54.212596 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-b6e82a39-8933-4eef-a9fd-3750492af0a7 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Image limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 10:21:54.213257 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-b6e82a39-8933-4eef-a9fd-3750492af0a7 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Flavor pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 10:21:54.213816 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-b6e82a39-8933-4eef-a9fd-3750492af0a7 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Image pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 10:21:54.214220 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-b6e82a39-8933-4eef-a9fd-3750492af0a7 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 10:21:54.225603 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b6e82a39-8933-4eef-a9fd-3750492af0a7 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:21:54.226158 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b6e82a39-8933-4eef-a9fd-3750492af0a7 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:21:54.226947 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b6e82a39-8933-4eef-a9fd-3750492af0a7 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:21:54.227402 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b6e82a39-8933-4eef-a9fd-3750492af0a7 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:21:54.244796 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-b6e82a39-8933-4eef-a9fd-3750492af0a7 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Getting quotas for project aaff1fa03a194074aa14fae9db94cefb. Resources: {'cores', 'ram', 'instances'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 10:21:54.249182 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.quota [None req-b6e82a39-8933-4eef-a9fd-3750492af0a7 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Getting quotas for user 2321028b4d4f4734afd1ce674931a4d3 and project aaff1fa03a194074aa14fae9db94cefb. Resources: {'cores', 'ram', 'instances'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 10:21:54.312245 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-b6e82a39-8933-4eef-a9fd-3750492af0a7 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Going to run 1 instances... {{(pid=117865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 10:21:54.314557 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-b6e82a39-8933-4eef-a9fd-3750492af0a7 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 8b1941f7-5e40-45d7-a2b1-d2570c46e098] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d76bcb03-cfef-4986-9b8d-91995ff4597f',volume_size=None,volume_type=None)] {{(pid=117865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 10:21:54.456350 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-b6e82a39-8933-4eef-a9fd-3750492af0a7 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.844409 Jul 04 10:21:54.456996 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 506/1015] 10.222.0.79 () {60 vars in 1146 bytes} [Mon Jul 4 10:21:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 10:21:54.466003 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:21:54.466807 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:21:54.471417 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-0fd5aca9-f85e-4b71-a1f1-21164bb1155b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:21:54.472277 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-0fd5aca9-f85e-4b71-a1f1-21164bb1155b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 8b1941f7-5e40-45d7-a2b1-d2570c46e098] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:21:54.535889 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-0fd5aca9-f85e-4b71-a1f1-21164bb1155b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:21:54.543641 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-0fd5aca9-f85e-4b71-a1f1-21164bb1155b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098" status: 200 len: 1095 microversion: 2.1 time: 0.079946 Jul 04 10:21:54.544142 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 510/1016] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:21:54 2022] GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098 => generated 1095 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:21:55.562039 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-ddee70eb-16cd-40e5-b7a3-4cb91c4ec23e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:21:55.562687 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-ddee70eb-16cd-40e5-b7a3-4cb91c4ec23e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 8b1941f7-5e40-45d7-a2b1-d2570c46e098] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:21:55.570214 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ddee70eb-16cd-40e5-b7a3-4cb91c4ec23e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:21:55.570936 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ddee70eb-16cd-40e5-b7a3-4cb91c4ec23e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:21:55.571762 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ddee70eb-16cd-40e5-b7a3-4cb91c4ec23e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:21:55.572242 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ddee70eb-16cd-40e5-b7a3-4cb91c4ec23e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:21:55.766854 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-ddee70eb-16cd-40e5-b7a3-4cb91c4ec23e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:21:55.777146 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-ddee70eb-16cd-40e5-b7a3-4cb91c4ec23e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098" status: 200 len: 1211 microversion: 2.1 time: 0.220040 Jul 04 10:21:55.777820 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 507/1017] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:21:55 2022] GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098 => generated 1211 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:21:56.794928 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-ebd73a7f-f70e-4293-a555-f44b926a68ba tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:21:56.795499 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-ebd73a7f-f70e-4293-a555-f44b926a68ba tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 8b1941f7-5e40-45d7-a2b1-d2570c46e098] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:21:56.802539 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ebd73a7f-f70e-4293-a555-f44b926a68ba tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:21:56.802991 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ebd73a7f-f70e-4293-a555-f44b926a68ba tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:21:56.803754 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ebd73a7f-f70e-4293-a555-f44b926a68ba tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:21:56.804183 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ebd73a7f-f70e-4293-a555-f44b926a68ba tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:21:57.021405 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-ebd73a7f-f70e-4293-a555-f44b926a68ba tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:21:57.033330 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-ebd73a7f-f70e-4293-a555-f44b926a68ba tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098" status: 200 len: 1267 microversion: 2.1 time: 0.242232 Jul 04 10:21:57.034129 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 511/1018] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:21:56 2022] GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098 => generated 1267 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 10:21:57.213392 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-79f9bd6f-30bf-446b-aca1-2639efd374c6 req-a55d4c65-7ed5-486a-b209-2c56955d89ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b1941f7-5e40-45d7-a2b1-d2570c46e098", "tag": "f6880b94-9560-44e7-a5e4-b1332c8add95"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:21:57.223942 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-79f9bd6f-30bf-446b-aca1-2639efd374c6 req-a55d4c65-7ed5-486a-b209-2c56955d89ce service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:21:57.225046 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-79f9bd6f-30bf-446b-aca1-2639efd374c6 req-a55d4c65-7ed5-486a-b209-2c56955d89ce service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:21:57.237951 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-79f9bd6f-30bf-446b-aca1-2639efd374c6 req-a55d4c65-7ed5-486a-b209-2c56955d89ce service nova] Creating event network-changed:f6880b94-9560-44e7-a5e4-b1332c8add95 for instance 8b1941f7-5e40-45d7-a2b1-d2570c46e098 on hv-cinder-84841 Jul 04 10:21:57.243592 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-79f9bd6f-30bf-446b-aca1-2639efd374c6 req-a55d4c65-7ed5-486a-b209-2c56955d89ce service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034125 Jul 04 10:21:57.244747 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 508/1019] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:21:58.052001 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-fec42f2a-46bf-47d0-85bb-14d5c06de08e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:21:58.052735 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-fec42f2a-46bf-47d0-85bb-14d5c06de08e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 8b1941f7-5e40-45d7-a2b1-d2570c46e098] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:21:58.060266 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-fec42f2a-46bf-47d0-85bb-14d5c06de08e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:21:58.060706 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-fec42f2a-46bf-47d0-85bb-14d5c06de08e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:21:58.061472 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-fec42f2a-46bf-47d0-85bb-14d5c06de08e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:21:58.061933 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-fec42f2a-46bf-47d0-85bb-14d5c06de08e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:21:58.292248 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-fec42f2a-46bf-47d0-85bb-14d5c06de08e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:21:58.300126 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-fec42f2a-46bf-47d0-85bb-14d5c06de08e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098" status: 200 len: 1267 microversion: 2.1 time: 0.253235 Jul 04 10:21:58.300772 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 512/1020] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:21:58 2022] GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098 => generated 1267 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:21:59.321830 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-686e6cd0-e310-49bd-af52-60e0979bc2d7 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:21:59.322826 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-686e6cd0-e310-49bd-af52-60e0979bc2d7 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 8b1941f7-5e40-45d7-a2b1-d2570c46e098] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:21:59.331584 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-686e6cd0-e310-49bd-af52-60e0979bc2d7 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:21:59.332028 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-686e6cd0-e310-49bd-af52-60e0979bc2d7 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:21:59.332813 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-686e6cd0-e310-49bd-af52-60e0979bc2d7 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:21:59.333236 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-686e6cd0-e310-49bd-af52-60e0979bc2d7 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:21:59.484744 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-686e6cd0-e310-49bd-af52-60e0979bc2d7 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:21:59.495287 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-686e6cd0-e310-49bd-af52-60e0979bc2d7 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098" status: 200 len: 1267 microversion: 2.1 time: 0.180883 Jul 04 10:21:59.496101 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 509/1021] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:21:59 2022] GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098 => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:22:00.517157 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-945ff275-bb40-492b-939c-883906dfbc68 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:22:00.518130 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-945ff275-bb40-492b-939c-883906dfbc68 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 8b1941f7-5e40-45d7-a2b1-d2570c46e098] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:22:00.524980 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-945ff275-bb40-492b-939c-883906dfbc68 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:22:00.525428 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-945ff275-bb40-492b-939c-883906dfbc68 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:22:00.526264 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-945ff275-bb40-492b-939c-883906dfbc68 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:22:00.526770 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-945ff275-bb40-492b-939c-883906dfbc68 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:22:00.661221 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-945ff275-bb40-492b-939c-883906dfbc68 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:22:00.672998 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-945ff275-bb40-492b-939c-883906dfbc68 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098" status: 200 len: 1267 microversion: 2.1 time: 0.162117 Jul 04 10:22:00.673682 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 513/1022] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:22:00 2022] GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:22:01.695160 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e6adc3a2-9f0e-4948-9234-56882b134efa tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:22:01.696097 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-e6adc3a2-9f0e-4948-9234-56882b134efa tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 8b1941f7-5e40-45d7-a2b1-d2570c46e098] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:22:01.707503 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e6adc3a2-9f0e-4948-9234-56882b134efa tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:22:01.708295 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e6adc3a2-9f0e-4948-9234-56882b134efa tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:22:01.709559 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e6adc3a2-9f0e-4948-9234-56882b134efa tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:22:01.710315 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e6adc3a2-9f0e-4948-9234-56882b134efa tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:22:01.857445 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-e6adc3a2-9f0e-4948-9234-56882b134efa tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:22:01.869169 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-e6adc3a2-9f0e-4948-9234-56882b134efa tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098" status: 200 len: 1267 microversion: 2.1 time: 0.180940 Jul 04 10:22:01.869986 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 510/1023] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:22:01 2022] GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098 => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:22:02.891527 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-25927594-8177-45ad-acf0-90ae4e95c2bb tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:22:02.892417 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-25927594-8177-45ad-acf0-90ae4e95c2bb tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 8b1941f7-5e40-45d7-a2b1-d2570c46e098] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:22:02.899608 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-25927594-8177-45ad-acf0-90ae4e95c2bb tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:22:02.900049 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-25927594-8177-45ad-acf0-90ae4e95c2bb tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:22:02.900795 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-25927594-8177-45ad-acf0-90ae4e95c2bb tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:22:02.901220 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-25927594-8177-45ad-acf0-90ae4e95c2bb tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:22:03.058735 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-25927594-8177-45ad-acf0-90ae4e95c2bb tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:22:03.070188 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-25927594-8177-45ad-acf0-90ae4e95c2bb tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098" status: 200 len: 1267 microversion: 2.1 time: 0.184536 Jul 04 10:22:03.071000 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 514/1024] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:22:02 2022] GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098 => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:22:04.095449 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b063dd19-dbeb-41b1-871e-eca683e2e744 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:22:04.096127 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-b063dd19-dbeb-41b1-871e-eca683e2e744 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 8b1941f7-5e40-45d7-a2b1-d2570c46e098] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:22:04.104382 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b063dd19-dbeb-41b1-871e-eca683e2e744 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:22:04.104916 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b063dd19-dbeb-41b1-871e-eca683e2e744 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:22:04.105857 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b063dd19-dbeb-41b1-871e-eca683e2e744 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:22:04.106375 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b063dd19-dbeb-41b1-871e-eca683e2e744 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:22:04.234026 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:22:04.256873 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-b063dd19-dbeb-41b1-871e-eca683e2e744 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:22:04.259995 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=6 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:22:04.268589 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-b063dd19-dbeb-41b1-871e-eca683e2e744 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098" status: 200 len: 1267 microversion: 2.1 time: 0.180123 Jul 04 10:22:04.269065 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 511/1025] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:22:04 2022] GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098 => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:22:05.290258 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-ad18c51b-6423-4be3-80d9-82d82f0a1191 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:22:05.291311 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-ad18c51b-6423-4be3-80d9-82d82f0a1191 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 8b1941f7-5e40-45d7-a2b1-d2570c46e098] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:22:05.295088 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell0:SELECT=2 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:22:05.302569 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ad18c51b-6423-4be3-80d9-82d82f0a1191 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:22:05.303019 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ad18c51b-6423-4be3-80d9-82d82f0a1191 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:22:05.303794 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ad18c51b-6423-4be3-80d9-82d82f0a1191 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:22:05.304227 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ad18c51b-6423-4be3-80d9-82d82f0a1191 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:22:05.446467 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-ad18c51b-6423-4be3-80d9-82d82f0a1191 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:22:05.454405 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-ad18c51b-6423-4be3-80d9-82d82f0a1191 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098" status: 200 len: 1267 microversion: 2.1 time: 0.171232 Jul 04 10:22:05.455067 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 515/1026] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:22:05 2022] GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:22:06.477725 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-aca5cc5d-e3d1-4904-9902-13b81df3c169 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:22:06.478583 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-aca5cc5d-e3d1-4904-9902-13b81df3c169 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 8b1941f7-5e40-45d7-a2b1-d2570c46e098] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:22:06.488714 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aca5cc5d-e3d1-4904-9902-13b81df3c169 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:22:06.489164 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aca5cc5d-e3d1-4904-9902-13b81df3c169 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:22:06.489964 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aca5cc5d-e3d1-4904-9902-13b81df3c169 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:22:06.490392 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aca5cc5d-e3d1-4904-9902-13b81df3c169 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:22:06.633304 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-aca5cc5d-e3d1-4904-9902-13b81df3c169 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:22:06.641402 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-aca5cc5d-e3d1-4904-9902-13b81df3c169 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098" status: 200 len: 1267 microversion: 2.1 time: 0.170296 Jul 04 10:22:06.642013 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 512/1027] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:22:06 2022] GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:22:06.756660 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 10:22:06.756968 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Mon Jul 4 10:22:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 10:22:07.659480 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-2a404e06-979d-41b8-a303-99912056c6f2 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:22:07.660069 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-2a404e06-979d-41b8-a303-99912056c6f2 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 8b1941f7-5e40-45d7-a2b1-d2570c46e098] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:22:07.666885 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2a404e06-979d-41b8-a303-99912056c6f2 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:22:07.667334 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2a404e06-979d-41b8-a303-99912056c6f2 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:22:07.668098 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2a404e06-979d-41b8-a303-99912056c6f2 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:22:07.668529 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-2a404e06-979d-41b8-a303-99912056c6f2 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:22:07.752523 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-14e51402-f6e8-4242-b37e-8ab2f0ab1975 req-7ddccaca-d8a4-4f4a-a6e1-0aef843ce82a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b1941f7-5e40-45d7-a2b1-d2570c46e098", "name": "network-vif-plugged", "status": "completed", "tag": "f6880b94-9560-44e7-a5e4-b1332c8add95"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:22:07.761959 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-14e51402-f6e8-4242-b37e-8ab2f0ab1975 req-7ddccaca-d8a4-4f4a-a6e1-0aef843ce82a service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:22:07.762721 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-14e51402-f6e8-4242-b37e-8ab2f0ab1975 req-7ddccaca-d8a4-4f4a-a6e1-0aef843ce82a service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:22:07.776556 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-14e51402-f6e8-4242-b37e-8ab2f0ab1975 req-7ddccaca-d8a4-4f4a-a6e1-0aef843ce82a service nova] Creating event network-vif-plugged:f6880b94-9560-44e7-a5e4-b1332c8add95 for instance 8b1941f7-5e40-45d7-a2b1-d2570c46e098 on hv-cinder-84841 Jul 04 10:22:07.782069 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-14e51402-f6e8-4242-b37e-8ab2f0ab1975 req-7ddccaca-d8a4-4f4a-a6e1-0aef843ce82a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033281 Jul 04 10:22:07.783011 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 513/1028] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 10:22:07.809751 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-2a404e06-979d-41b8-a303-99912056c6f2 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:22:07.819197 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-2a404e06-979d-41b8-a303-99912056c6f2 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098" status: 200 len: 1267 microversion: 2.1 time: 0.163403 Jul 04 10:22:07.828880 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 516/1029] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:22:07 2022] GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:22:08.842566 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-faa2e174-2c75-4831-8155-b6c176453e22 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:22:08.843712 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-faa2e174-2c75-4831-8155-b6c176453e22 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 8b1941f7-5e40-45d7-a2b1-d2570c46e098] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:22:08.854865 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-faa2e174-2c75-4831-8155-b6c176453e22 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:22:08.855610 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-faa2e174-2c75-4831-8155-b6c176453e22 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:22:08.856877 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-faa2e174-2c75-4831-8155-b6c176453e22 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:22:08.857610 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-faa2e174-2c75-4831-8155-b6c176453e22 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:22:09.012985 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-faa2e174-2c75-4831-8155-b6c176453e22 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:22:09.020912 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-faa2e174-2c75-4831-8155-b6c176453e22 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098" status: 200 len: 1267 microversion: 2.1 time: 0.186506 Jul 04 10:22:09.021809 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 514/1030] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:22:08 2022] GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098 => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:22:10.041365 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-34d392f5-e518-42ef-b1a7-79d46414cb2b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:22:10.042383 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-34d392f5-e518-42ef-b1a7-79d46414cb2b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 8b1941f7-5e40-45d7-a2b1-d2570c46e098] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:22:10.053753 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-34d392f5-e518-42ef-b1a7-79d46414cb2b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:22:10.054526 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-34d392f5-e518-42ef-b1a7-79d46414cb2b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:22:10.055792 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-34d392f5-e518-42ef-b1a7-79d46414cb2b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:22:10.056511 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-34d392f5-e518-42ef-b1a7-79d46414cb2b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:22:10.205558 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-34d392f5-e518-42ef-b1a7-79d46414cb2b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:22:10.213731 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-34d392f5-e518-42ef-b1a7-79d46414cb2b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098" status: 200 len: 1453 microversion: 2.1 time: 0.178772 Jul 04 10:22:10.214297 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 517/1031] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:22:10 2022] GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098 => generated 1453 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:22:10.233108 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-55b3009d-7913-4a6f-89e5-8fd9b5390edd tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:22:10.233842 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-55b3009d-7913-4a6f-89e5-8fd9b5390edd tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 8b1941f7-5e40-45d7-a2b1-d2570c46e098] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:22:10.241545 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-55b3009d-7913-4a6f-89e5-8fd9b5390edd tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:22:10.242036 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-55b3009d-7913-4a6f-89e5-8fd9b5390edd tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:22:10.242795 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-55b3009d-7913-4a6f-89e5-8fd9b5390edd tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:22:10.243226 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-55b3009d-7913-4a6f-89e5-8fd9b5390edd tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:22:10.385416 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-55b3009d-7913-4a6f-89e5-8fd9b5390edd tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:22:10.393465 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-55b3009d-7913-4a6f-89e5-8fd9b5390edd tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098" status: 200 len: 1453 microversion: 2.1 time: 0.166341 Jul 04 10:22:10.394064 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 515/1032] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:22:10 2022] GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098 => generated 1453 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:22:12.101905 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-9d20350f-51ba-47d4-b7e5-9958f1ea2f3a req-2fcf8ee5-5987-4472-ad1e-8fcd23ce1793 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b1941f7-5e40-45d7-a2b1-d2570c46e098", "tag": "f6880b94-9560-44e7-a5e4-b1332c8add95"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:22:12.110166 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-9d20350f-51ba-47d4-b7e5-9958f1ea2f3a req-2fcf8ee5-5987-4472-ad1e-8fcd23ce1793 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:22:12.110608 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-9d20350f-51ba-47d4-b7e5-9958f1ea2f3a req-2fcf8ee5-5987-4472-ad1e-8fcd23ce1793 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:22:12.122234 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-9d20350f-51ba-47d4-b7e5-9958f1ea2f3a req-2fcf8ee5-5987-4472-ad1e-8fcd23ce1793 service nova] Creating event network-changed:f6880b94-9560-44e7-a5e4-b1332c8add95 for instance 8b1941f7-5e40-45d7-a2b1-d2570c46e098 on hv-cinder-84841 Jul 04 10:22:12.128492 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-9d20350f-51ba-47d4-b7e5-9958f1ea2f3a req-2fcf8ee5-5987-4472-ad1e-8fcd23ce1793 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121198 Jul 04 10:22:12.129394 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 518/1033] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:23:42.493799 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_api:SELECT=20 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:23:42.494447 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-87d48cf4-8e65-4e7c-a82b-37af9860ac5f tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:23:42.494447 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-87d48cf4-8e65-4e7c-a82b-37af9860ac5f tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 8b1941f7-5e40-45d7-a2b1-d2570c46e098] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:23:42.495731 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG dbcounter [-] [117866] Writing DB stats nova_cell1:SELECT=44 {{(pid=117866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:23:42.498176 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:23:42.498883 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=48 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:23:42.500617 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-6c8117f8-bc29-4279-82a6-e0928263b8aa req-925f0f38-8a38-4b0f-9060-8ab7bc1ec78e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b1941f7-5e40-45d7-a2b1-d2570c46e098", "tag": "f6880b94-9560-44e7-a5e4-b1332c8add95"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:23:42.502748 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-87d48cf4-8e65-4e7c-a82b-37af9860ac5f tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:23:42.503255 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-87d48cf4-8e65-4e7c-a82b-37af9860ac5f tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:23:42.504297 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-87d48cf4-8e65-4e7c-a82b-37af9860ac5f tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:23:42.505093 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-87d48cf4-8e65-4e7c-a82b-37af9860ac5f tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:23:42.510892 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-6c8117f8-bc29-4279-82a6-e0928263b8aa req-925f0f38-8a38-4b0f-9060-8ab7bc1ec78e service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:23:42.511325 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-6c8117f8-bc29-4279-82a6-e0928263b8aa req-925f0f38-8a38-4b0f-9060-8ab7bc1ec78e service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:23:42.522841 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-6c8117f8-bc29-4279-82a6-e0928263b8aa req-925f0f38-8a38-4b0f-9060-8ab7bc1ec78e service nova] Creating event network-changed:f6880b94-9560-44e7-a5e4-b1332c8add95 for instance 8b1941f7-5e40-45d7-a2b1-d2570c46e098 on hv-cinder-84841 Jul 04 10:23:42.528509 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-6c8117f8-bc29-4279-82a6-e0928263b8aa req-925f0f38-8a38-4b0f-9060-8ab7bc1ec78e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036663 Jul 04 10:23:42.529929 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 519/1034] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:23:42.536083 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-87d48cf4-8e65-4e7c-a82b-37af9860ac5f tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 8b1941f7-5e40-45d7-a2b1-d2570c46e098] Going to try to terminate instance {{(pid=117865) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 10:23:42.630485 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-87d48cf4-8e65-4e7c-a82b-37af9860ac5f tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098" status: 204 len: 0 microversion: 2.1 time: 0.140792 Jul 04 10:23:42.631538 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 516/1035] 10.222.0.79 () {58 vars in 1238 bytes} [Mon Jul 4 10:23:42 2022] DELETE /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 10:23:42.640557 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-d0fb6cb6-2538-4699-973e-24583aef6603 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:23:42.641637 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-d0fb6cb6-2538-4699-973e-24583aef6603 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 8b1941f7-5e40-45d7-a2b1-d2570c46e098] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:23:42.649499 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d0fb6cb6-2538-4699-973e-24583aef6603 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:23:42.649897 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d0fb6cb6-2538-4699-973e-24583aef6603 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:23:42.650670 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d0fb6cb6-2538-4699-973e-24583aef6603 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:23:42.651104 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-d0fb6cb6-2538-4699-973e-24583aef6603 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:23:42.848125 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-d0fb6cb6-2538-4699-973e-24583aef6603 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:23:42.856248 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-d0fb6cb6-2538-4699-973e-24583aef6603 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098" status: 200 len: 1577 microversion: 2.1 time: 0.220160 Jul 04 10:23:42.856808 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 520/1036] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:23:42 2022] GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098 => generated 1577 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:23:43.878463 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e49eb523-a47b-4c67-a9b4-e7991a98e7d4 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:23:43.879864 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-e49eb523-a47b-4c67-a9b4-e7991a98e7d4 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 8b1941f7-5e40-45d7-a2b1-d2570c46e098] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:23:43.887942 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e49eb523-a47b-4c67-a9b4-e7991a98e7d4 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:23:43.888389 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e49eb523-a47b-4c67-a9b4-e7991a98e7d4 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:23:43.889167 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e49eb523-a47b-4c67-a9b4-e7991a98e7d4 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:23:43.889595 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e49eb523-a47b-4c67-a9b4-e7991a98e7d4 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:23:44.077574 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-e49eb523-a47b-4c67-a9b4-e7991a98e7d4 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:23:44.085928 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-e49eb523-a47b-4c67-a9b4-e7991a98e7d4 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098" status: 200 len: 1577 microversion: 2.1 time: 0.214284 Jul 04 10:23:44.086510 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 517/1037] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:23:43 2022] GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098 => generated 1577 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:23:44.666880 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-8d4e95f6-ca1e-44d7-b3ca-20ca5b5c8561 req-52059c96-f1ed-4958-8735-66a8898f30cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b1941f7-5e40-45d7-a2b1-d2570c46e098", "name": "network-vif-deleted", "tag": "f6880b94-9560-44e7-a5e4-b1332c8add95"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:23:44.677732 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-8d4e95f6-ca1e-44d7-b3ca-20ca5b5c8561 req-52059c96-f1ed-4958-8735-66a8898f30cb service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:23:44.678244 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-8d4e95f6-ca1e-44d7-b3ca-20ca5b5c8561 req-52059c96-f1ed-4958-8735-66a8898f30cb service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:23:44.693303 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-8d4e95f6-ca1e-44d7-b3ca-20ca5b5c8561 req-52059c96-f1ed-4958-8735-66a8898f30cb service nova] Creating event network-vif-deleted:f6880b94-9560-44e7-a5e4-b1332c8add95 for instance 8b1941f7-5e40-45d7-a2b1-d2570c46e098 on hv-cinder-84841 Jul 04 10:23:44.698285 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-8d4e95f6-ca1e-44d7-b3ca-20ca5b5c8561 req-52059c96-f1ed-4958-8735-66a8898f30cb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035199 Jul 04 10:23:44.699010 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 521/1038] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:23:45.104176 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5901cf88-abc5-45cb-a8d1-3d6a636a63be tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:23:45.104787 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-5901cf88-abc5-45cb-a8d1-3d6a636a63be tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 8b1941f7-5e40-45d7-a2b1-d2570c46e098] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:23:45.111578 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5901cf88-abc5-45cb-a8d1-3d6a636a63be tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:23:45.112027 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5901cf88-abc5-45cb-a8d1-3d6a636a63be tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:23:45.112788 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5901cf88-abc5-45cb-a8d1-3d6a636a63be tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:23:45.113223 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5901cf88-abc5-45cb-a8d1-3d6a636a63be tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:23:45.150524 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5901cf88-abc5-45cb-a8d1-3d6a636a63be tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:23:45.151194 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5901cf88-abc5-45cb-a8d1-3d6a636a63be tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:23:45.151894 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.objects.instance [None req-5901cf88-abc5-45cb-a8d1-3d6a636a63be tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lazy-loading 'fault' on Instance uuid 8b1941f7-5e40-45d7-a2b1-d2570c46e098 {{(pid=117865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 10:23:45.196336 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-5901cf88-abc5-45cb-a8d1-3d6a636a63be tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:23:45.204141 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-5901cf88-abc5-45cb-a8d1-3d6a636a63be tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098" status: 200 len: 1231 microversion: 2.1 time: 0.103908 Jul 04 10:23:45.204676 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 518/1039] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:23:45 2022] GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098 => generated 1231 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:23:46.227003 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-326c7e36-9279-4af3-a6a6-b29815e81f63 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:23:46.227934 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-326c7e36-9279-4af3-a6a6-b29815e81f63 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 8b1941f7-5e40-45d7-a2b1-d2570c46e098] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:23:46.236823 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-326c7e36-9279-4af3-a6a6-b29815e81f63 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:23:46.237444 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-326c7e36-9279-4af3-a6a6-b29815e81f63 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:23:46.238484 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-326c7e36-9279-4af3-a6a6-b29815e81f63 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:23:46.239151 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-326c7e36-9279-4af3-a6a6-b29815e81f63 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:23:46.252427 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.wsgi [None req-326c7e36-9279-4af3-a6a6-b29815e81f63 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] HTTP exception thrown: Instance 8b1941f7-5e40-45d7-a2b1-d2570c46e098 could not be found. Jul 04 10:23:46.254370 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-326c7e36-9279-4af3-a6a6-b29815e81f63 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Request method failure captured: Jul 04 10:23:46.254370 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: request: GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098 HTTP/1.1 Jul 04 10:23:46.254370 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept: application/json Jul 04 10:23:46.254370 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept-Encoding: identity Jul 04 10:23:46.254370 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Connection: close Jul 04 10:23:46.254370 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Length: 0 Jul 04 10:23:46.254370 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Type: application/json Jul 04 10:23:46.254370 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Host: 10.222.0.79 Jul 04 10:23:46.254370 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Openstack-System-Scope: None Jul 04 10:23:46.254370 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: User-Agent: python-urllib3/1.26.9 Jul 04 10:23:46.254370 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Auth-Token: gAAAAABiwr4kTUQJmRY3LQuZKqYus7xRPQ1jwudPqj5BMIXPUiZp2STyJC9AnDvU5QsfHsflZih4ckOfyCYJk4kDxT_ace37WZhM2ldYcLl7R5ZJRlUWsxbBfHPOnmDfPE5gzwZzU42sdcikHk4B6gqZF-YKVOjXIlOOoYJvkrTeT1rS_5jMslE Jul 04 10:23:46.254370 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Id: None Jul 04 10:23:46.254370 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Name: None Jul 04 10:23:46.254370 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Identity-Status: Confirmed Jul 04 10:23:46.254370 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Is-Admin-Project: True Jul 04 10:23:46.254370 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Id: default Jul 04 10:23:46.254370 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Name: Default Jul 04 10:23:46.254370 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Id: aaff1fa03a194074aa14fae9db94cefb Jul 04 10:23:46.254370 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Name: tempest-TestVolumeBootPattern-862963616 Jul 04 10:23:46.254370 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Role: reader,member Jul 04 10:23:46.254370 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Roles: reader,member Jul 04 10:23:46.256266 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/aaff1fa03a194074aa14fae9db94cefb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_aaff1fa03a194074aa14fae9db94cefb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/aaff1fa03a194074aa14fae9db94cefb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/aaff1fa03a194074aa14fae9db94cefb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:23:46.256266 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant: tempest-TestVolumeBootPattern-862963616 Jul 04 10:23:46.256266 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Id: aaff1fa03a194074aa14fae9db94cefb Jul 04 10:23:46.256266 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Name: tempest-TestVolumeBootPattern-862963616 Jul 04 10:23:46.256266 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User: tempest-TestVolumeBootPattern-862963616-project Jul 04 10:23:46.256266 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Id: default Jul 04 10:23:46.256266 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Name: Default Jul 04 10:23:46.256266 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Id: 2321028b4d4f4734afd1ce674931a4d3 Jul 04 10:23:46.256266 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Name: tempest-TestVolumeBootPattern-862963616-project Jul 04 10:23:46.256266 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: method: > Jul 04 10:23:46.256266 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: exception: Instance 8b1941f7-5e40-45d7-a2b1-d2570c46e098 could not be found. Jul 04 10:23:46.256266 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: action_args: {'id': '8b1941f7-5e40-45d7-a2b1-d2570c46e098'} Jul 04 10:23:46.257085 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:23:46.257085 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:23:46.257085 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:23:46.257085 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:23:46.257085 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:23:46.257085 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:23:46.257085 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:23:46.257085 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:23:46.257085 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:23:46.257085 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:23:46.257085 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b1941f7-5e40-45d7-a2b1-d2570c46e098 could not be found. Jul 04 10:23:46.257085 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:23:46.257085 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:23:46.257085 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:23:46.257085 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:23:46.257085 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:23:46.257085 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:23:46.257085 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:23:46.257085 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:23:46.257085 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:23:46.258618 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:23:46.258618 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 10:23:46.258618 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 10:23:46.258618 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:23:46.258618 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:23:46.258618 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:23:46.258618 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:23:46.258618 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b1941f7-5e40-45d7-a2b1-d2570c46e098 could not be found. Jul 04 10:23:46.258618 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:23:46.258618 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:23:46.258618 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:23:46.258618 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:23:46.258618 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:23:46.258618 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:23:46.258618 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:23:46.258618 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:23:46.258618 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b1941f7-5e40-45d7-a2b1-d2570c46e098 could not be found. Jul 04 10:23:46.258618 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:23:46.259867 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-326c7e36-9279-4af3-a6a6-b29815e81f63 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Returning 404 to user: Instance 8b1941f7-5e40-45d7-a2b1-d2570c46e098 could not be found. {{(pid=117866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:23:46.259867 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-326c7e36-9279-4af3-a6a6-b29815e81f63 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098" status: 404 len: 111 microversion: 2.1 time: 0.036024 Jul 04 10:23:46.259867 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 522/1040] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:23:46 2022] GET /compute/v2.1/servers/8b1941f7-5e40-45d7-a2b1-d2570c46e098 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:23:46.945261 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 10:23:46.945688 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Mon Jul 4 10:23:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 10:23:49.648589 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-1181d2bf-7315-49fe-b213-7066cdfe5851 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:23:49.649722 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-1181d2bf-7315-49fe-b213-7066cdfe5851 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 343223e4-5ea9-4347-8cb7-82aafa314cba] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:23:49.650643 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-2526c28b-9b3a-4b90-90da-a144bb1041a1 req-195493f0-c922-436f-8b6a-cb65242318e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "343223e4-5ea9-4347-8cb7-82aafa314cba", "tag": "18bb8690-9fd0-473c-a2fc-7b49d7d836f2"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:23:49.656511 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1181d2bf-7315-49fe-b213-7066cdfe5851 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:23:49.656966 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1181d2bf-7315-49fe-b213-7066cdfe5851 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:23:49.657804 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1181d2bf-7315-49fe-b213-7066cdfe5851 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:23:49.658242 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1181d2bf-7315-49fe-b213-7066cdfe5851 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:23:49.660441 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-2526c28b-9b3a-4b90-90da-a144bb1041a1 req-195493f0-c922-436f-8b6a-cb65242318e8 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:23:49.660945 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-2526c28b-9b3a-4b90-90da-a144bb1041a1 req-195493f0-c922-436f-8b6a-cb65242318e8 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:23:49.671879 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-2526c28b-9b3a-4b90-90da-a144bb1041a1 req-195493f0-c922-436f-8b6a-cb65242318e8 service nova] Creating event network-changed:18bb8690-9fd0-473c-a2fc-7b49d7d836f2 for instance 343223e4-5ea9-4347-8cb7-82aafa314cba on hv-cinder-84841 Jul 04 10:23:49.677436 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-2526c28b-9b3a-4b90-90da-a144bb1041a1 req-195493f0-c922-436f-8b6a-cb65242318e8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030409 Jul 04 10:23:49.678309 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 523/1041] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:23:49.687867 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-1181d2bf-7315-49fe-b213-7066cdfe5851 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 343223e4-5ea9-4347-8cb7-82aafa314cba] Going to try to terminate instance {{(pid=117865) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 10:23:49.778672 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-1181d2bf-7315-49fe-b213-7066cdfe5851 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "DELETE /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba" status: 204 len: 0 microversion: 2.1 time: 0.133882 Jul 04 10:23:49.779668 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 519/1042] 10.222.0.79 () {58 vars in 1238 bytes} [Mon Jul 4 10:23:49 2022] DELETE /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 10:23:49.789192 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-277949f8-14c6-49d0-815c-b33b07f20f52 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:23:49.790217 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-277949f8-14c6-49d0-815c-b33b07f20f52 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 343223e4-5ea9-4347-8cb7-82aafa314cba] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:23:49.797372 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-277949f8-14c6-49d0-815c-b33b07f20f52 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:23:49.798035 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-277949f8-14c6-49d0-815c-b33b07f20f52 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:23:49.798898 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-277949f8-14c6-49d0-815c-b33b07f20f52 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:23:49.799436 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-277949f8-14c6-49d0-815c-b33b07f20f52 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:23:49.944144 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.policy [None req-277949f8-14c6-49d0-815c-b33b07f20f52 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:23:49.952162 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-277949f8-14c6-49d0-815c-b33b07f20f52 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba" status: 200 len: 1576 microversion: 2.1 time: 0.167368 Jul 04 10:23:49.952966 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 524/1043] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:23:49 2022] GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:23:50.971852 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-3258a4c1-0ba5-47de-9791-348705e2fe66 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:23:50.972424 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-3258a4c1-0ba5-47de-9791-348705e2fe66 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 343223e4-5ea9-4347-8cb7-82aafa314cba] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:23:50.979770 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3258a4c1-0ba5-47de-9791-348705e2fe66 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:23:50.980215 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3258a4c1-0ba5-47de-9791-348705e2fe66 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:23:50.980990 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3258a4c1-0ba5-47de-9791-348705e2fe66 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:23:50.981424 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3258a4c1-0ba5-47de-9791-348705e2fe66 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:23:51.119120 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-3258a4c1-0ba5-47de-9791-348705e2fe66 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:23:51.129403 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-3258a4c1-0ba5-47de-9791-348705e2fe66 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba" status: 200 len: 1576 microversion: 2.1 time: 0.162285 Jul 04 10:23:51.130662 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 520/1044] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:23:50 2022] GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:23:51.711965 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [req-5125e95c-1272-4ad4-aa78-b2e27494a3ac req-3dd6ad10-9d7c-4bc4-8445-ffd60cfacf47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "343223e4-5ea9-4347-8cb7-82aafa314cba", "name": "network-vif-deleted", "tag": "18bb8690-9fd0-473c-a2fc-7b49d7d836f2"}]} {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 10:23:51.721157 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-5125e95c-1272-4ad4-aa78-b2e27494a3ac req-3dd6ad10-9d7c-4bc4-8445-ffd60cfacf47 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:23:51.721601 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [req-5125e95c-1272-4ad4-aa78-b2e27494a3ac req-3dd6ad10-9d7c-4bc4-8445-ffd60cfacf47 service nova] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:23:51.733222 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.compute.server_external_events [req-5125e95c-1272-4ad4-aa78-b2e27494a3ac req-3dd6ad10-9d7c-4bc4-8445-ffd60cfacf47 service nova] Creating event network-vif-deleted:18bb8690-9fd0-473c-a2fc-7b49d7d836f2 for instance 343223e4-5ea9-4347-8cb7-82aafa314cba on hv-cinder-84841 Jul 04 10:23:51.738515 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [req-5125e95c-1272-4ad4-aa78-b2e27494a3ac req-3dd6ad10-9d7c-4bc4-8445-ffd60cfacf47 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030395 Jul 04 10:23:51.739130 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 525/1045] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Jul 4 10:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 10:23:52.146768 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-c33f8513-dfde-48d7-b6ec-c78f84c2863b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:23:52.147497 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-c33f8513-dfde-48d7-b6ec-c78f84c2863b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 343223e4-5ea9-4347-8cb7-82aafa314cba] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:23:52.156323 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c33f8513-dfde-48d7-b6ec-c78f84c2863b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:23:52.156933 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c33f8513-dfde-48d7-b6ec-c78f84c2863b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:23:52.158049 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c33f8513-dfde-48d7-b6ec-c78f84c2863b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:23:52.158486 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c33f8513-dfde-48d7-b6ec-c78f84c2863b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:23:52.192958 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c33f8513-dfde-48d7-b6ec-c78f84c2863b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:23:52.193591 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c33f8513-dfde-48d7-b6ec-c78f84c2863b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:23:52.194290 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.objects.instance [None req-c33f8513-dfde-48d7-b6ec-c78f84c2863b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lazy-loading 'fault' on Instance uuid 343223e4-5ea9-4347-8cb7-82aafa314cba {{(pid=117865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 10:23:52.245489 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.policy [None req-c33f8513-dfde-48d7-b6ec-c78f84c2863b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321028b4d4f4734afd1ce674931a4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaff1fa03a194074aa14fae9db94cefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 10:23:52.256658 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-c33f8513-dfde-48d7-b6ec-c78f84c2863b tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba" status: 200 len: 1230 microversion: 2.1 time: 0.113793 Jul 04 10:23:52.257255 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 521/1046] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:23:52 2022] GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba => generated 1230 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 10:23:53.282420 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-1d56bce2-3d20-418e-a964-1f4c4f356365 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:23:53.283615 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-1d56bce2-3d20-418e-a964-1f4c4f356365 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 343223e4-5ea9-4347-8cb7-82aafa314cba] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:23:53.294381 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1d56bce2-3d20-418e-a964-1f4c4f356365 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:23:53.295130 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1d56bce2-3d20-418e-a964-1f4c4f356365 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:23:53.296384 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1d56bce2-3d20-418e-a964-1f4c4f356365 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:23:53.297095 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-1d56bce2-3d20-418e-a964-1f4c4f356365 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:23:53.315996 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.wsgi [None req-1d56bce2-3d20-418e-a964-1f4c4f356365 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] HTTP exception thrown: Instance 343223e4-5ea9-4347-8cb7-82aafa314cba could not be found. Jul 04 10:23:53.317608 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-1d56bce2-3d20-418e-a964-1f4c4f356365 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Request method failure captured: Jul 04 10:23:53.317608 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: request: GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba HTTP/1.1 Jul 04 10:23:53.317608 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept: application/json Jul 04 10:23:53.317608 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept-Encoding: identity Jul 04 10:23:53.317608 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Connection: close Jul 04 10:23:53.317608 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Length: 0 Jul 04 10:23:53.317608 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Type: application/json Jul 04 10:23:53.317608 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Host: 10.222.0.79 Jul 04 10:23:53.317608 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Openstack-System-Scope: None Jul 04 10:23:53.317608 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: User-Agent: python-urllib3/1.26.9 Jul 04 10:23:53.317608 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Auth-Token: gAAAAABiwr4kTUQJmRY3LQuZKqYus7xRPQ1jwudPqj5BMIXPUiZp2STyJC9AnDvU5QsfHsflZih4ckOfyCYJk4kDxT_ace37WZhM2ldYcLl7R5ZJRlUWsxbBfHPOnmDfPE5gzwZzU42sdcikHk4B6gqZF-YKVOjXIlOOoYJvkrTeT1rS_5jMslE Jul 04 10:23:53.317608 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Id: None Jul 04 10:23:53.317608 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Name: None Jul 04 10:23:53.317608 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Identity-Status: Confirmed Jul 04 10:23:53.317608 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Is-Admin-Project: True Jul 04 10:23:53.317608 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Id: default Jul 04 10:23:53.317608 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Name: Default Jul 04 10:23:53.317608 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Id: aaff1fa03a194074aa14fae9db94cefb Jul 04 10:23:53.317608 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Name: tempest-TestVolumeBootPattern-862963616 Jul 04 10:23:53.317608 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Role: reader,member Jul 04 10:23:53.317608 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Roles: reader,member Jul 04 10:23:53.319329 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/aaff1fa03a194074aa14fae9db94cefb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_aaff1fa03a194074aa14fae9db94cefb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/aaff1fa03a194074aa14fae9db94cefb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/aaff1fa03a194074aa14fae9db94cefb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:23:53.319329 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant: tempest-TestVolumeBootPattern-862963616 Jul 04 10:23:53.319329 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Id: aaff1fa03a194074aa14fae9db94cefb Jul 04 10:23:53.319329 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Name: tempest-TestVolumeBootPattern-862963616 Jul 04 10:23:53.319329 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User: tempest-TestVolumeBootPattern-862963616-project Jul 04 10:23:53.319329 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Id: default Jul 04 10:23:53.319329 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Name: Default Jul 04 10:23:53.319329 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Id: 2321028b4d4f4734afd1ce674931a4d3 Jul 04 10:23:53.319329 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Name: tempest-TestVolumeBootPattern-862963616-project Jul 04 10:23:53.319329 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: method: > Jul 04 10:23:53.319329 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: exception: Instance 343223e4-5ea9-4347-8cb7-82aafa314cba could not be found. Jul 04 10:23:53.319329 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: action_args: {'id': '343223e4-5ea9-4347-8cb7-82aafa314cba'} Jul 04 10:23:53.320355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:23:53.320355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:23:53.320355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:23:53.320355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:23:53.320355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:23:53.320355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:23:53.320355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:23:53.320355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:23:53.320355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:23:53.320355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:23:53.320355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 343223e4-5ea9-4347-8cb7-82aafa314cba could not be found. Jul 04 10:23:53.320355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:23:53.320355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:23:53.320355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:23:53.320355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:23:53.320355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:23:53.320355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:23:53.320355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:23:53.320355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:23:53.320355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:23:53.322002 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:23:53.322002 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 10:23:53.322002 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 10:23:53.322002 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:23:53.322002 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:23:53.322002 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:23:53.322002 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:23:53.322002 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 343223e4-5ea9-4347-8cb7-82aafa314cba could not be found. Jul 04 10:23:53.322002 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:23:53.322002 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:23:53.322002 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:23:53.322002 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:23:53.322002 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:23:53.322002 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:23:53.322002 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:23:53.322002 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:23:53.322002 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 343223e4-5ea9-4347-8cb7-82aafa314cba could not be found. Jul 04 10:23:53.322002 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:23:53.323563 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-1d56bce2-3d20-418e-a964-1f4c4f356365 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Returning 404 to user: Instance 343223e4-5ea9-4347-8cb7-82aafa314cba could not be found. {{(pid=117866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:23:53.323563 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-1d56bce2-3d20-418e-a964-1f4c4f356365 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba" status: 404 len: 111 microversion: 2.1 time: 0.045122 Jul 04 10:23:53.323563 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 526/1047] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:23:53 2022] GET /compute/v2.1/servers/343223e4-5ea9-4347-8cb7-82aafa314cba => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:23:54.049541 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b21d6021-57b6-46e7-8154-469cd68ba164 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:23:54.050109 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-b21d6021-57b6-46e7-8154-469cd68ba164 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 0ab0336f-8710-421e-8d13-a3ca20ccdb6a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:23:54.056909 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b21d6021-57b6-46e7-8154-469cd68ba164 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:23:54.057343 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b21d6021-57b6-46e7-8154-469cd68ba164 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:23:54.058135 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b21d6021-57b6-46e7-8154-469cd68ba164 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:23:54.058558 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b21d6021-57b6-46e7-8154-469cd68ba164 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:23:54.071714 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-b21d6021-57b6-46e7-8154-469cd68ba164 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] HTTP exception thrown: Instance 0ab0336f-8710-421e-8d13-a3ca20ccdb6a could not be found. Jul 04 10:23:54.073339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b21d6021-57b6-46e7-8154-469cd68ba164 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Request method failure captured: Jul 04 10:23:54.073339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: request: DELETE /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a HTTP/1.1 Jul 04 10:23:54.073339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept: application/json Jul 04 10:23:54.073339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Accept-Encoding: identity Jul 04 10:23:54.073339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Connection: close Jul 04 10:23:54.073339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Length: 0 Jul 04 10:23:54.073339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Content-Type: application/json Jul 04 10:23:54.073339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Host: 10.222.0.79 Jul 04 10:23:54.073339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 04 10:23:54.073339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 04 10:23:54.073339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Auth-Token: gAAAAABiwr4kTUQJmRY3LQuZKqYus7xRPQ1jwudPqj5BMIXPUiZp2STyJC9AnDvU5QsfHsflZih4ckOfyCYJk4kDxT_ace37WZhM2ldYcLl7R5ZJRlUWsxbBfHPOnmDfPE5gzwZzU42sdcikHk4B6gqZF-YKVOjXIlOOoYJvkrTeT1rS_5jMslE Jul 04 10:23:54.073339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Id: None Jul 04 10:23:54.073339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Domain-Name: None Jul 04 10:23:54.073339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 04 10:23:54.073339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 04 10:23:54.073339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 04 10:23:54.073339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 04 10:23:54.073339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Id: aaff1fa03a194074aa14fae9db94cefb Jul 04 10:23:54.073339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Project-Name: tempest-TestVolumeBootPattern-862963616 Jul 04 10:23:54.073339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Role: reader,member Jul 04 10:23:54.073339 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Roles: reader,member Jul 04 10:23:54.074783 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/aaff1fa03a194074aa14fae9db94cefb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_aaff1fa03a194074aa14fae9db94cefb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/aaff1fa03a194074aa14fae9db94cefb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/aaff1fa03a194074aa14fae9db94cefb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:23:54.074783 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant: tempest-TestVolumeBootPattern-862963616 Jul 04 10:23:54.074783 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Id: aaff1fa03a194074aa14fae9db94cefb Jul 04 10:23:54.074783 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-Tenant-Name: tempest-TestVolumeBootPattern-862963616 Jul 04 10:23:54.074783 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User: tempest-TestVolumeBootPattern-862963616-project Jul 04 10:23:54.074783 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 04 10:23:54.074783 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 04 10:23:54.074783 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Id: 2321028b4d4f4734afd1ce674931a4d3 Jul 04 10:23:54.074783 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: X-User-Name: tempest-TestVolumeBootPattern-862963616-project Jul 04 10:23:54.074783 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: method: > Jul 04 10:23:54.074783 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: exception: Instance 0ab0336f-8710-421e-8d13-a3ca20ccdb6a could not be found. Jul 04 10:23:54.074783 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: action_args: {'id': '0ab0336f-8710-421e-8d13-a3ca20ccdb6a'} Jul 04 10:23:54.075605 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:23:54.075605 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:23:54.075605 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:23:54.075605 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:23:54.075605 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:23:54.075605 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:23:54.075605 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:23:54.075605 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:23:54.075605 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:23:54.075605 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:23:54.075605 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ab0336f-8710-421e-8d13-a3ca20ccdb6a could not be found. Jul 04 10:23:54.075605 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:23:54.075605 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:23:54.075605 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:23:54.075605 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:23:54.075605 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:23:54.075605 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:23:54.075605 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:23:54.075605 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:23:54.075605 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:23:54.077137 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:23:54.077137 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 10:23:54.077137 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 10:23:54.077137 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 10:23:54.077137 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 10:23:54.077137 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:23:54.077137 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:23:54.077137 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:23:54.077137 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:23:54.077137 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ab0336f-8710-421e-8d13-a3ca20ccdb6a could not be found. Jul 04 10:23:54.077137 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:23:54.077137 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:23:54.077137 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:23:54.077137 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:23:54.077137 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:23:54.077137 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:23:54.077137 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:23:54.077137 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:23:54.077137 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ab0336f-8710-421e-8d13-a3ca20ccdb6a could not be found. Jul 04 10:23:54.077137 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 04 10:23:54.079040 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b21d6021-57b6-46e7-8154-469cd68ba164 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Returning 404 to user: Instance 0ab0336f-8710-421e-8d13-a3ca20ccdb6a could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:23:54.079040 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-b21d6021-57b6-46e7-8154-469cd68ba164 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a" status: 404 len: 111 microversion: 2.1 time: 0.029367 Jul 04 10:23:54.079040 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 522/1048] 10.222.0.79 () {58 vars in 1238 bytes} [Mon Jul 4 10:23:54 2022] DELETE /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:23:54.085832 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-ebd0096a-e49a-499a-a71c-8444b5dabbb0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '>' {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:23:54.087057 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.compute.api [None req-ebd0096a-e49a-499a-a71c-8444b5dabbb0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] [instance: 0ab0336f-8710-421e-8d13-a3ca20ccdb6a] Fetching instance by UUID {{(pid=117866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 10:23:54.096809 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ebd0096a-e49a-499a-a71c-8444b5dabbb0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:23:54.097453 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ebd0096a-e49a-499a-a71c-8444b5dabbb0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:23:54.098646 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ebd0096a-e49a-499a-a71c-8444b5dabbb0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 10:23:54.099187 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG oslo_concurrency.lockutils [None req-ebd0096a-e49a-499a-a71c-8444b5dabbb0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Lock "fcfe76a9-294c-4e42-99a5-517031194304" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 10:23:54.113487 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.wsgi [None req-ebd0096a-e49a-499a-a71c-8444b5dabbb0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] HTTP exception thrown: Instance 0ab0336f-8710-421e-8d13-a3ca20ccdb6a could not be found. Jul 04 10:23:54.115026 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-ebd0096a-e49a-499a-a71c-8444b5dabbb0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Request method failure captured: Jul 04 10:23:54.115026 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: request: GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a HTTP/1.1 Jul 04 10:23:54.115026 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept: application/json Jul 04 10:23:54.115026 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Accept-Encoding: identity Jul 04 10:23:54.115026 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Connection: close Jul 04 10:23:54.115026 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Length: 0 Jul 04 10:23:54.115026 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Content-Type: application/json Jul 04 10:23:54.115026 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Host: 10.222.0.79 Jul 04 10:23:54.115026 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Openstack-System-Scope: None Jul 04 10:23:54.115026 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: User-Agent: python-urllib3/1.26.9 Jul 04 10:23:54.115026 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Auth-Token: gAAAAABiwr4kTUQJmRY3LQuZKqYus7xRPQ1jwudPqj5BMIXPUiZp2STyJC9AnDvU5QsfHsflZih4ckOfyCYJk4kDxT_ace37WZhM2ldYcLl7R5ZJRlUWsxbBfHPOnmDfPE5gzwZzU42sdcikHk4B6gqZF-YKVOjXIlOOoYJvkrTeT1rS_5jMslE Jul 04 10:23:54.115026 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Id: None Jul 04 10:23:54.115026 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Domain-Name: None Jul 04 10:23:54.115026 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Identity-Status: Confirmed Jul 04 10:23:54.115026 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Is-Admin-Project: True Jul 04 10:23:54.115026 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Id: default Jul 04 10:23:54.115026 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Domain-Name: Default Jul 04 10:23:54.115026 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Id: aaff1fa03a194074aa14fae9db94cefb Jul 04 10:23:54.115026 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Project-Name: tempest-TestVolumeBootPattern-862963616 Jul 04 10:23:54.115026 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Role: reader,member Jul 04 10:23:54.115026 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Roles: reader,member Jul 04 10:23:54.117315 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/aaff1fa03a194074aa14fae9db94cefb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_aaff1fa03a194074aa14fae9db94cefb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/aaff1fa03a194074aa14fae9db94cefb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/aaff1fa03a194074aa14fae9db94cefb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}] Jul 04 10:23:54.117315 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant: tempest-TestVolumeBootPattern-862963616 Jul 04 10:23:54.117315 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Id: aaff1fa03a194074aa14fae9db94cefb Jul 04 10:23:54.117315 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-Tenant-Name: tempest-TestVolumeBootPattern-862963616 Jul 04 10:23:54.117315 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User: tempest-TestVolumeBootPattern-862963616-project Jul 04 10:23:54.117315 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Id: default Jul 04 10:23:54.117315 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Domain-Name: Default Jul 04 10:23:54.117315 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Id: 2321028b4d4f4734afd1ce674931a4d3 Jul 04 10:23:54.117315 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: X-User-Name: tempest-TestVolumeBootPattern-862963616-project Jul 04 10:23:54.117315 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: method: > Jul 04 10:23:54.117315 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: exception: Instance 0ab0336f-8710-421e-8d13-a3ca20ccdb6a could not be found. Jul 04 10:23:54.117315 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: action_args: {'id': '0ab0336f-8710-421e-8d13-a3ca20ccdb6a'} Jul 04 10:23:54.118355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: {{(pid=117866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 10:23:54.118355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:23:54.118355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 10:23:54.118355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 10:23:54.118355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 10:23:54.118355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 10:23:54.118355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 10:23:54.118355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 10:23:54.118355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 10:23:54.118355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 10:23:54.118355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ab0336f-8710-421e-8d13-a3ca20ccdb6a could not be found. Jul 04 10:23:54.118355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:23:54.118355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:23:54.118355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:23:54.118355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:23:54.118355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:23:54.118355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:23:54.118355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 10:23:54.118355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 10:23:54.118355 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 10:23:54.119899 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 10:23:54.119899 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 10:23:54.119899 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 10:23:54.119899 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 10:23:54.119899 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 10:23:54.119899 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 10:23:54.119899 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 10:23:54.119899 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ab0336f-8710-421e-8d13-a3ca20ccdb6a could not be found. Jul 04 10:23:54.119899 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:23:54.119899 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 10:23:54.119899 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:23:54.119899 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 10:23:54.119899 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 10:23:54.119899 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 10:23:54.119899 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 10:23:54.119899 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 10:23:54.119899 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ab0336f-8710-421e-8d13-a3ca20ccdb6a could not be found. Jul 04 10:23:54.119899 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: ERROR nova.api.openstack.wsgi Jul 04 10:23:54.121340 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: DEBUG nova.api.openstack.wsgi [None req-ebd0096a-e49a-499a-a71c-8444b5dabbb0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Returning 404 to user: Instance 0ab0336f-8710-421e-8d13-a3ca20ccdb6a could not be found. {{(pid=117866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 10:23:54.121340 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO nova.api.openstack.requestlog [None req-ebd0096a-e49a-499a-a71c-8444b5dabbb0 tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a" status: 404 len: 111 microversion: 2.1 time: 0.036808 Jul 04 10:23:54.121340 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: [pid: 117866|app: 0|req: 527/1049] 10.222.0.79 () {58 vars in 1235 bytes} [Mon Jul 4 10:23:54 2022] GET /compute/v2.1/servers/0ab0336f-8710-421e-8d13-a3ca20ccdb6a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 10:23:55.456948 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-3a88f4b3-82bf-4187-8062-c1f6a376a92e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] Calling method '.version_select at 0x7f28081505e0>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 10:23:55.484534 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-3a88f4b3-82bf-4187-8062-c1f6a376a92e tempest-TestVolumeBootPattern-862963616 tempest-TestVolumeBootPattern-862963616-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1580130653" status: 202 len: 0 microversion: 2.1 time: 0.031345 Jul 04 10:23:55.485450 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 523/1050] 10.222.0.79 () {58 vars in 1262 bytes} [Mon Jul 4 10:23:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1580130653 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 10:25:25.986838 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 10:25:25.987457 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Mon Jul 4 10:25:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 10:27:06.072476 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 10:27:06.073183 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Mon Jul 4 10:27:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 10:27:06.773413 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 10:27:06.773829 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Mon Jul 4 10:27:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 10:27:06.959141 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 10:27:06.959983 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Mon Jul 4 10:27:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 10:28:45.997491 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 10:28:45.998292 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Mon Jul 4 10:28:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 10:29:05.103091 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 10:29:05.104234 dv-cinder-848418-1-iscsi devstack@n-api.service[117866]: Mon Jul 4 10:29:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 10:29:08.399942 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 10:29:08.400846 dv-cinder-848418-1-iscsi devstack@n-api.service[117865]: Mon Jul 4 10:29:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!